The saved dataset is saved in various file "shards". By default, the dataset output is divided to shards inside of a spherical-robin vogue but tailor made sharding is often specified by way of the shard_func operate. One example is, It can save you the dataset to working with a single shard as follows:Both time period frequency and inverse document