게시물
A Hugging Face engineer processed 1.2 million CommonCrawl pages for under $1 using DataTrove, now running natively on Hugging Face Jobs. No Slurm cluster needed. The same pipeline code works with just a simple executor swap, cloud tasks fan out automatically, and CPU filtering plus GPU work together.
1mo
0 좋아요0 싫어요0 리포스트0 댓글
?
댓글
아직 댓글이 없습니다. 첫 댓글을 남겨보세요!