데이터셋
고품질 오픈소스 AI 학습 데이터셋
Hugging Face 데이터셋 수집
Hugging Face가 호스팅하는 웹 최대 규모의 오픈소스 데이터셋 허브로, NLP·컴퓨터 비전·오디오·멀티모달 작업을 아우릅니다. 커뮤니티가 기여한 수십만 개의 데이터셋과 효율적인 스트리밍·로딩 도구를 제공하며, 텍스트 분류 벤치마크·이미지-캡션 쌍·음성-텍스트 말뭉치 등 고품질 학습 데이터를 찾는 곳입니다.
Kaggle Datasets Platform
Kaggle은 머신러닝 대회, 실무 문제, 학술 연구를 아우르는 수만 개의 공개 데이터셋을 호스팅합니다. 모든 데이터셋은 내장 노트북으로 온라인 분석이 가능하며, 로컬 실험과 모델 훈련을 위해 직접 다운로드할 수 있습니다.
코드 데이터셋이 포함된 논문
Papers with Code는 학술 논문의 벤치마크 데이터셋을 해당 SOTA 모델 및 오픈소스 구현과 연결하여, 방법 비교, 결과 재현, 연구에 적합한 데이터셋과 코드 베이스라인 찾기를 쉽게 합니다.
구글 데이터셋 검색
Google Dataset Search는 수천 개 출처의 공개 데이터셋을 인덱싱하는 전용 검색엔진으로, 연구자와 개발자가 호스팅 위치에 관계없이 훈련·분석·검증에 필요한 특정 데이터를 빠르게 찾을 수 있습니다.
공통 크롤 웹 코퍼스
Common Crawl는 페타바이트 규모의 오픈 웹 크롤링 코퍼스로, 많은 대규모 언어 모델의 사전학습 데이터 기반 소스로 활용됩니다. 이 코퍼스는 무료로 다운로드할 수 있으며 NLP 연구, 데이터 마이닝, 대규모 머신러닝 실험에 널리 사용됩니다.
LAION Open 멀티모달 데이터셋
LAION(Large-Scale Artificial Intelligence Open Network)은 CLIP, Stable Diffusion 등 멀티모달 모델 학습에 널리 사용된 대규모 오픈 이미지-텍스트 쌍 데이터셋을 제공합니다. 이 데이터셋은 무료로 제공되며 오픈소스 생성 AI 연구의 핵심 인프라로 활용됩니다.
UCI 머신러닝 저장소
UCI 머신러닝 저장소는 1990년대 후반부터 유지되어 온 수백 개의 정형 데이터셋 컬렉션으로, 실습, 알고리즘 벤치마킹, 전 세계 대학의 머신러닝 기초 교육에 널리 활용되고 있습니다.
스택 소스 코드 데이터셋
The Stack은 BigCode 프로젝트의 관대한 라이선스 대규모 소스코드 데이터셋으로, 수백 개의 프로그래밍 언어를 포괄합니다. 코드 생성 모델의 사전학습과 평가에 널리 사용되며, 책임 있는 데이터 활용을 위한 옵트아웃 메커니즘과 중복 제거 도구를 갖추고 있습니다.
이미지넷
ImageNet은 수천 개 범주에 걸친 수백만 장의 라벨링된 이미지를 갖춘 기념비적 대규모 이미지 데이터셋입니다. ILSVRC 벤치마크 대회를 통해 컴퓨터 비전의 딥러닝 혁명을 이끌었으며, 지금도 사전학습, 전이학습, 이미지 분류 모델 평가의 토대로 남아 있습니다.
alpaca cleaned
yahma/alpaca-cleaned is a community dataset on Hugging Face with 876 likes and 24,234 recent downloads.
Alpaca CoT
QingyiSi/Alpaca-CoT is a community dataset on Hugging Face with 786 likes and 9,743 recent downloads.
alpaca
tatsu-lab/alpaca is a community dataset on Hugging Face with 1104 likes and 119,254 recent downloads.
bad prompt
Nerfgun3/bad_prompt is a community dataset on Hugging Face with 963 likes and 1,957 recent downloads.
c4
allenai/c4 is a community dataset on Hugging Face with 643 likes and 1,282,773 recent downloads.
Chinese DeepSeek R1 Distill data 110k
Congliu/Chinese-DeepSeek-R1-Distill-data-110k is a community dataset on Hugging Face with 781 likes and 1,087 recent downloads.
COIG CQIA
m-a-p/COIG-CQIA is a community dataset on Hugging Face with 768 likes and 27,976 recent downloads.
cosmopedia
HuggingFaceTB/cosmopedia is a community dataset on Hugging Face with 742 likes and 26,991 recent downloads.
CulturaX
uonlp/CulturaX is a community dataset on Hugging Face with 674 likes and 18,353 recent downloads.
databricks dolly 15k
databricks/databricks-dolly-15k is a community dataset on Hugging Face with 1084 likes and 63,630 recent downloads.
diffusiondb
poloclub/diffusiondb is a community dataset on Hugging Face with 653 likes and 13,093 recent downloads.
dolma
allenai/dolma is a community dataset on Hugging Face with 1074 likes and 2,784 recent downloads.
EasyNegative
gsdf/EasyNegative is a community dataset on Hugging Face with 1212 likes and 27,637 recent downloads.
falcon refinedweb
tiiuae/falcon-refinedweb is a community dataset on Hugging Face with 953 likes and 82,020 recent downloads.
finepdfs
HuggingFaceFW/finepdfs is a community dataset on Hugging Face with 928 likes and 52,686 recent downloads.
fineweb
HuggingFaceFW/fineweb is a community dataset on Hugging Face with 3287 likes and 429,372 recent downloads.
fineweb 2
HuggingFaceFW/fineweb-2 is a community dataset on Hugging Face with 864 likes and 92,367 recent downloads.
fineweb edu
HuggingFaceFW/fineweb-edu is a community dataset on Hugging Face with 1272 likes and 405,910 recent downloads.
GAIA
gaia-benchmark/GAIA is a community dataset on Hugging Face with 783 likes and 10,260 recent downloads.
glue
nyu-mll/glue is a community dataset on Hugging Face with 730 likes and 784,661 recent downloads.
gsm8k
openai/gsm8k is a community dataset on Hugging Face with 1593 likes and 1,235,950 recent downloads.
hh rlhf
Anthropic/hh-rlhf is a community dataset on Hugging Face with 2010 likes and 39,057 recent downloads.
hle
cais/hle is a community dataset on Hugging Face with 948 likes and 40,101 recent downloads.
imagenet 1k
ILSVRC/imagenet-1k is a community dataset on Hugging Face with 896 likes and 114,854 recent downloads.
imdb
stanfordnlp/imdb is a community dataset on Hugging Face with 699 likes and 189,340 recent downloads.
Infinity Instruct
BAAI/Infinity-Instruct is a community dataset on Hugging Face with 756 likes and 3,673 recent downloads.
internship warehouse
FlyRank/internship-warehouse is a community dataset on Hugging Face with 588 likes and 18,716 recent downloads.
Llama Nemotron Post Training Dataset
nvidia/Llama-Nemotron-Post-Training-Dataset is a community dataset on Hugging Face with 700 likes and 7,276 recent downloads.
LLaVA Instruct 150K
liuhaotian/LLaVA-Instruct-150K is a community dataset on Hugging Face with 635 likes and 5,676 recent downloads.
lmsys chat 1m
lmsys/lmsys-chat-1m is a community dataset on Hugging Face with 984 likes and 6,496 recent downloads.
medical o1 reasoning SFT
FreedomIntelligence/medical-o1-reasoning-SFT is a community dataset on Hugging Face with 1176 likes and 17,355 recent downloads.
medical prescription english audio
HumynLabs/medical-prescription-english-audio is a community dataset on Hugging Face with 716 likes and 152 recent downloads.
mmlu
cais/mmlu is a community dataset on Hugging Face with 826 likes and 714,868 recent downloads.
MNBVC
liwu/MNBVC is a community dataset on Hugging Face with 652 likes and 99,676 recent downloads.
NuminaMath CoT
AI-MO/NuminaMath-CoT is a community dataset on Hugging Face with 599 likes and 161,288 recent downloads.
oasst1
OpenAssistant/oasst1 is a community dataset on Hugging Face with 1567 likes and 30,179 recent downloads.
OpenHermes 2.5
teknium/OpenHermes-2.5 is a community dataset on Hugging Face with 896 likes and 32,526 recent downloads.
OpenOrca
Open-Orca/OpenOrca is a community dataset on Hugging Face with 1589 likes and 25,012 recent downloads.
OpenR1 Math 220k
open-r1/OpenR1-Math-220k is a community dataset on Hugging Face with 787 likes and 126,715 recent downloads.
OpenThoughts 114k
open-thoughts/OpenThoughts-114k is a community dataset on Hugging Face with 907 likes and 110,694 recent downloads.
Opus 4.6 Reasoning 3000x filtered
nohurry/Opus-4.6-Reasoning-3000x-filtered is a community dataset on Hugging Face with 648 likes and 586 recent downloads.
PersonaHub
proj-persona/PersonaHub is a community dataset on Hugging Face with 797 likes and 11,476 recent downloads.
PhysicalAI Autonomous Vehicles
nvidia/PhysicalAI-Autonomous-Vehicles is a community dataset on Hugging Face with 1003 likes and 208,205 recent downloads.
prompts.chat
fka/prompts.chat is a community dataset on Hugging Face with 9815 likes and 25,078 recent downloads.
RedPajama Data 1T
togethercomputer/RedPajama-Data-1T is a community dataset on Hugging Face with 1190 likes and 2,094 recent downloads.
ShareGPT Vicuna unfiltered
anon8231489123/ShareGPT_Vicuna_unfiltered is a community dataset on Hugging Face with 915 likes and 419,677 recent downloads.
squad
rajpurkar/squad is a community dataset on Hugging Face with 709 likes and 265,395 recent downloads.
synthetic text to sql
gretelai/synthetic_text_to_sql is a community dataset on Hugging Face with 691 likes and 2,938 recent downloads.
the stack v2
bigcode/the-stack-v2 is a community dataset on Hugging Face with 624 likes and 5,758 recent downloads.
TinyStories
roneneldan/TinyStories is a community dataset on Hugging Face with 1140 likes and 84,980 recent downloads.
ultrachat 200k
HuggingFaceH4/ultrachat_200k is a community dataset on Hugging Face with 885 likes and 112,449 recent downloads.
+ 948 more — 전체 보기 →