← Back to Submind

Topic

data parallelism

Similarities and differences of Spark, Dask, and Ray by Holden Karau

Big Things Conference

Holden Karau presents a comprehensive overview of Spark, Dask, and Ray as distributed systems designed primarily for data parallelism. He begins by establishing the fundamental challenges inherent in building such systems, noting that while they allow us to ignore complex issues like network partiti …