0x3/freesound-laion-640k
About this Repository This repository is a re-upload of the FreeSound.org dataset as curated by LAION for the larger LAION-Audio-630k dataset, with the following changes: Limited columns to only the audio and basic metadata. Incorporated necessary information for licensing and attribution. Removed ambiguously licensed samples, amounting to around 1,000 total samples. What about download links? Links were ommitted for the sake of size, as they can be constructed… See the full description on the dataset page: https://huggingface.co/datasets/0x3/freesound-laion-640k.
Thành tựu nổi bật
Những danh hiệu mới nhất của dự án
#1 Repository Của Tuần
#1 Repository Của Tháng
#1 Repository Của Tuần
🔉 Bộ dữ liệu âm thanh FreeSound-LAION 640k — nguồn âm thanh lớn đã được làm sạch license
Bộ dữ liệu âm thanh 640.000 mẫu từ FreeSound.org, do LAION tổng hợp và làm sạch license, phù hợp cho huấn luyện mô hình âm thanh và phân loại.
Đây là bản re-upload của bộ dữ liệu FreeSound.org do LAION chọn lọc cho bộ lớn LAION-Audio-630k. Dự án giới hạn cột chỉ còn audio và metadata cơ bản, kèm thông tin license và attribution cần thiết, đồng thời loại bỏ ~1.000 mẫu có license mơ hồ.
✨ Điểm nổi bật
- Audio + metadata: Bao gồm audio, title, description, tags, username, freesound_id.
- License rõ ràng: 6 loại license CC (CC0, CC-BY, CC-BY-NC, CC-Sampling+) kèm cột attribution_required và commercial_use.
- Đã làm sạch: Loại bỏ ~1.000 mẫu có license không rõ ràng.
- Hỗ trợ tái tạo link: Link tải có thể tái tạo từ username và freesound_id theo format: https://freesound.org/people/{username}/sound/{id}.
- Quy mô lớn: 505.618 mẫu train, 50.599 mẫu test.
- Định dạng Parquet: Hỗ trợ tải về dưới dạng Parquet, tương thích với thư viện datasets, dask, polars.
💡 Vì sao đáng chú ý
Khác với các bộ dữ liệu âm thanh khác thườch thường thiếu thông tin license rõ ràng, bản làm việc này chuẩn hóa 6 loại license Creative Commons và thêm hai cột phụ trợ quyết định sử dụng thương mại và yêu cầu ghi công. Đây là lựa chọn lý tưởng cho việc huấn luyện mô hình audio-to-audio, audio-classification mà không lo rủi ro pháp lý từ license.
#AudioDataset #FreeSound #LAION #AudioClassification #AITraining #TiniX
Similar Projects
Discover other similar projects and AI models.
Dataset Card for UltraChat 200k Dataset Description This is a heavily filtered version of the UltraChat dataset and was used to train Zephyr-7B-β, a state of the art 7b chat model. The original datasets consists of 1.4M dialogues generated by ChatGPT and spanning a wide range of topics. To create UltraChat 200k, we applied the following logic: Selection of a subset of data for faster supervised fine tuning. Truecasing of the dataset, as we observed around 5% of… See the full description on the dataset page: https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k.
[!NOTE] We have released a paper for OpenThoughts! See our paper here. Open-Thoughts-114k Open synthetic reasoning dataset with 114k high-quality examples covering math, science, code, and puzzles! Inspect the content with rich formatting with Curator Viewer. Available Subsets default subset containing ready-to-train data used to finetune the OpenThinker-7B and OpenThinker-32B models: ds = load_dataset("open-thoughts/OpenThoughts-114k"… See the full description on the dataset page: https://huggingface.co/datasets/open-thoughts/OpenThoughts-114k.
OpenR1-Math-220k Dataset description OpenR1-Math-220k is a large-scale dataset for mathematical reasoning. It consists of 220k math problems with two to four reasoning traces generated by DeepSeek R1 for problems from NuminaMath 1.5. The traces were verified using Math Verify for most samples and Llama-3.3-70B-Instruct as a judge for 12% of the samples, and each problem contains at least one reasoning trace with a correct answer. The dataset consists of two… See the full description on the dataset page: https://huggingface.co/datasets/open-r1/OpenR1-Math-220k.
Dataset Card for HH-RLHF Dataset Summary This repository provides access to two different kinds of data: Human preference data about helpfulness and harmlessness from Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback. These data are meant to train preference (or reward) models for subsequent RLHF training. These data are not meant for supervised training of dialogue agents. Training dialogue agents on these data is likely… See the full description on the dataset page: https://huggingface.co/datasets/Anthropic/hh-rlhf.
Dataset Card for Wikimedia Wikipedia Dataset Summary Wikipedia dataset containing cleaned articles of all languages. The dataset is built from the Wikipedia dumps (https://dumps.wikimedia.org/) with one subset per language, each containing a single train split. Each example contains the content of one full Wikipedia article with cleaning to strip markdown and unwanted sections (references, etc.). All language subsets have already been processed for recent dump… See the full description on the dataset page: https://huggingface.co/datasets/wikimedia/wikipedia.
🐋 The OpenOrca Dataset! 🐋 We are thrilled to announce the release of the OpenOrca dataset! This rich collection of augmented FLAN data aligns, as best as possible, with the distributions outlined in the Orca paper. It has been instrumental in generating high-performing model checkpoints and serves as a valuable resource for all NLP researchers and developers! Official Models Mistral-7B-OpenOrca Our latest model, the first 7B to score better overall than all… See the full description on the dataset page: https://huggingface.co/datasets/Open-Orca/OpenOrca.
📚 FineWeb-Edu 1.3 trillion tokens of the finest educational data the 🌐 web has to offer Paper: https://arxiv.org/abs/2406.17557 What is it? 📚 FineWeb-Edu dataset consists of 1.3T tokens and 5.4T tokens (FineWeb-Edu-score-2) of educational web pages filtered from 🍷 FineWeb dataset. This is the 1.3 trillion version. To enhance FineWeb's quality, we developed an educational quality classifier using annotations generated by LLama3-70B-Instruct. We… See the full description on the dataset page: https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu.
Dataset containing synthetically generated (by GPT-3.5 and GPT-4) short stories that only use a small vocabulary. Described in the following paper: https://arxiv.org/abs/2305.07759. The models referred to in the paper were trained on TinyStories-train.txt (the file tinystories-valid.txt can be used for validation loss). These models can be found on Huggingface, at roneneldan/TinyStories-1M/3M/8M/28M/33M/1Layer-21M. Additional resources: tinystories_all_data.tar.gz - contains a superset of… See the full description on the dataset page: https://huggingface.co/datasets/roneneldan/TinyStories.
Dataset Card for "wikitext" Dataset Summary The WikiText language modeling dataset is a collection of over 100 million tokens extracted from the set of verified Good and Featured articles on Wikipedia. The dataset is available under the Creative Commons Attribution-ShareAlike License. Compared to the preprocessed version of Penn Treebank (PTB), WikiText-2 is over 2 times larger and WikiText-103 is over 110 times larger. The WikiText dataset also features a far… See the full description on the dataset page: https://huggingface.co/datasets/Salesforce/wikitext.