The movement of data on the internet is a major challenge for researchers in BIG Sciences. Over the past decade, we can see that it is not only in BIG Science that generates large amount of data, but also Internet of Things (IoT) as standards of the data resolution being captured continues to evolve.
We have also seen increases of network bandwidth, from mega to Giga, and 100s of Gbps. Despite this high bandwidth capacity, researchers are still not experiencing the corresponding increase in the “speed” of data transfer. This is due to multiple factors: server, transport protocol, etc.
The Data Mover Challenge (DMC) aims to bring together experts from industry and academia, in a bid to test their software across servers located in various countries (Australia, Japan, Singapore, USA) that are connected by 100G international networks.