In the medium-term, FastAI.jl will move to depend on MLUtils.jl instead of MLDataPattern.jl + LearnBase.jl + DataLoaders.jl.
Data container transformations
groupobs, joinobs and the likes in transformations.jl. These have already been copied over to MLUtils.jl in JuliaML/MLUtils.jl#21. Functions here can be removed once FastAI.jl depends on MLUtils.jl.
DataLoader
Path to replace dependency on DataLoaders.jl. Support for parallel data iterators has been merged into MLUtils.jl (JuliaML/MLUtils.jl#33), but is not released (yet) and since it uses a different task scheduler than DataLoaders.jl, possible performance regressions on full training workloads still need to be benchmarked.
If that is not an issue and MLUtils.jl releases a stable DataLoader with feature parity of DataLoaders.jl, the dependency on DataLoaders.jl will be dropped.
In the medium-term, FastAI.jl will move to depend on MLUtils.jl instead of MLDataPattern.jl + LearnBase.jl + DataLoaders.jl.
Data container transformations
groupobs,joinobsand the likes intransformations.jl. These have already been copied over to MLUtils.jl in JuliaML/MLUtils.jl#21. Functions here can be removed once FastAI.jl depends on MLUtils.jl.DataLoaderPath to replace dependency on DataLoaders.jl. Support for parallel data iterators has been merged into MLUtils.jl (JuliaML/MLUtils.jl#33), but is not released (yet) and since it uses a different task scheduler than DataLoaders.jl, possible performance regressions on full training workloads still need to be benchmarked.
If that is not an issue and MLUtils.jl releases a stable
DataLoaderwith feature parity of DataLoaders.jl, the dependency on DataLoaders.jl will be dropped.