Skip to content

Synchronize grain/python/experimental.py with grain/experimental.py #1181

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
bzantium wants to merge 1 commit into
base: main
Choose a base branch
from
+7 −49
Open

Synchronize grain/python/experimental.py with grain/experimental.py #1181

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 6 additions & 2 deletions grain/experimental.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,8 +19,10 @@
# pylint: disable=g-multiple-import
# pylint: disable=unused-import

from grain._src.core.transforms import FlatMapTransform

from grain._src.core.transforms import (
FlatMapTransform,
MapWithIndex as MapWithIndexTransform,
)
from grain._src.python.dataset.base import (
DatasetOptions,
ExecutionTrackingMode,
Expand All @@ -44,6 +46,8 @@
)
from grain._src.python.dataset.transformations.limit import LimitIterDataset
from grain._src.python.dataset.transformations.map import RngPool

from grain._src.python.dataset.transformations.mix import ConcatenateMapDataset
from grain._src.python.dataset.transformations.packing import (
FirstFitPackIterDataset,
BestFitPackIterDataset,
Expand Down
48 changes: 1 addition & 47 deletions grain/python/experimental.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,50 +22,4 @@
# pylint: disable=g-multiple-import
# pylint: disable=unused-import

from grain._src.python.dataset.base import (
DatasetOptions,
ExecutionTrackingMode,
)
from grain._src.python.dataset.dataset import (
apply_transformations,
WithOptionsIterDataset,
)
from grain._src.python.dataset.sources.parquet_dataset import ParquetIterDataset
from grain._src.python.dataset.transformations.batch import batch_and_pad
from grain._src.python.dataset.transformations.flatmap import (
FlatMapMapDataset,
FlatMapIterDataset,
)
from grain._src.python.dataset.transformations.interleave import (
InterleaveIterDataset,
)
from grain._src.python.dataset.transformations.limit import LimitIterDataset
from grain._src.python.dataset.transformations.map import RngPool
from grain._src.python.dataset.transformations.mix import ConcatenateMapDataset
from grain._src.python.dataset.transformations.packing import FirstFitPackIterDataset
from grain._src.python.dataset.transformations.packing_concat_then_split import (
BOSHandling,
ConcatThenSplitIterDataset,
)
from grain._src.python.dataset.transformations.prefetch import (
ThreadPrefetchIterDataset,
ThreadPrefetchDatasetIterator,
)
from grain._src.python.dataset.transformations.shuffle import (
WindowShuffleMapDataset,
WindowShuffleIterDataset,
)
from grain._src.python.dataset.transformations.zip import (
ZipMapDataset,
ZipIterDataset,
)
from grain._src.core.transforms import (
FlatMapTransform,
MapWithIndex as MapWithIndexTransform,
)
from grain._src.python.experimental.example_packing.packing import PackAndBatchOperation

# This should evetually live under grain.testing.
from grain._src.python.testing.experimental import assert_equal_output_after_checkpoint

from grain._src.python.experimental.index_shuffle.python.index_shuffle_module import index_shuffle
from grain.experimental import *