core.scripts.make_lmdb_sizes

core.scripts.make_lmdb_sizes#

Copyright (c) Meta Platforms, Inc. and affiliates.

This source code is licensed under the MIT license found in the LICENSE file in the root directory of this source tree.

This script provides the functionality to generate metadata.npz files necessary for load_balancing the DataLoader.

Attributes#

parser

Functions#

get_data(index)

make_lmdb_sizes(→ None)

get_lmdb_sizes_parser()

Module Contents#

core.scripts.make_lmdb_sizes.get_data(index)#
core.scripts.make_lmdb_sizes.make_lmdb_sizes(args) → None#
core.scripts.make_lmdb_sizes.get_lmdb_sizes_parser()#
core.scripts.make_lmdb_sizes.parser#
Contents