Skip to main content

Blog

Learn About Our Meetup

5000+ Members

MEETUPS

LEARN, CONNECT, SHARE

Join our meetup, learn, connect, share, and get to know your Toronto AI community. 

JOB POSTINGS

INDEED POSTINGS

Browse through the latest deep learning, ai, machine learning postings from Indeed for the GTA.

CONTACT

CONNECT WITH US

Are you looking to sponsor space, be a speaker, or volunteer, feel free to give us a shout.

[D] Reflinks vs. Symlinks vs. Hard Links: How They Can Help ML Projects

In ML projects hard links and symbolic links can help us, when setting up new experiments, to rearrange data files quickly and efficiently. However, with traditional links, we run the risk of polluting the data files with erroneous edits.

The article explain details of using links, some cool new stuff in modern file systems (reflinks), and an example of how DVC (Data Version Control) tool leverages this for managing ML project datasets and workflow: Reflinks vs symlinks vs hard links, and how they can help machine learning projects

submitted by /u/cmstrump
[link] [comments]