Back to Trending
Dataset
mrs83

mrs83/kurtis_mental_health_dpo

⚠️ Content Warning This dataset contains content that some users may find offensive or harmful. Viewer discretion is advised. Model Card: Kurtis DPO dataset. Description This dataset was created using the microsoft/Phi-3.5-mini-instruct model to generate adversarial responses for alignment training. The model was particularly effective in crafting toxic, biased, or otherwise harmful responses to provided prompts. These responses were then filtered… See the full description on the dataset page: https://huggingface.co/datasets/mrs83/kurtis_mental_health_dpo.

4likes
14downloads
0views

Thành tựu nổi bật

Những danh hiệu mới nhất của dự án

2
TINIX TRENDING·Chủ đề: arxiv:2305.18290

#2 Repository Của Tuần

4
TINIX TRENDING·Chủ đề: dpo

#4 Repository Của Tuần

9
TINIX TRENDING·Chủ đề: synthetic

#9 Repository Của Tuần

🧠 Dataset huấn luyện an toàn AI với phản hồi đối lập độc hại

Bộ dữ liệu này được sinh bởi mô hình Phi-3.5-mini-instruct nhằm tạo ra các phản hồi độc hại, thiên vị để huấn luyện DPO.

Dataset kurtis_mental_health_dpo được tạo ra bằng cách sử dụng mô hình microsoft/Phi-3.5-mini-instruct để sinh ra các phản hồi mang tính đối lập — độc hại, thiên vị hoặc gây hại — dựa trên các prompt đã cho. Những phản hồi này sau đó được lọc và xử lý để đảm bảo chất lượng cao cho bộ dữ liệu dùng trong Direct Preference Optimization (DPO).

✨ Điểm nổi bật

  • Mô hình nguồn: Sinh bởi microsoft/Phi-3.5-mini-instruct, mạnh về khả năng tạo nội dung đối lập.
  • Mục đích sử dụng: Hỗ trợ xây dựng bộ dữ liệu để huấn luyện rèn luyện an toàn AI, phát hiện và giảm thiểu nội dung độc hại.
  • Cấu trúc dữ liệu: Bao gồm cặp chosen (phản hồi tốt) và rejected (phản hồi độc hại), đặc biệt nhấn mạnh hành vi đối lập.
  • Xử lý chất lượng: Các phản hồi đã qua lọc để đảm bảo tính phù hợp cho huấn luyện DPO.

💡 Vì sao đáng chú ý

Khác với cách tiếp cận thu thập dữ liệu thủ công, bộ dữ liệu này tận dụng sức mạnh của mô hình sinh để tạo ra các kịch bản đối lập phong phú, đa dạng — tiết kiệm thời gian và chi phí so với việc thu thập bởi con người. Phù hợp cho nghiên cứu về an toàn AI, phát triển bộ phân loại nội dung độc hại, và huấn luyện mô hình theo đúng hướng an toàn.


#DPO #AISafety #Phi35 #TextGeneration #Dataset

Similar Projects

Discover other similar projects and AI models.

Dataset
openai/gsm8k

Dataset Card for GSM8K Dataset Summary GSM8K (Grade School Math 8K) is a dataset of 8.5K high quality linguistically diverse grade school math word problems. The dataset was created to support the task of question answering on basic mathematical problems that require multi-step reasoning. These problems take between 2 and 8 steps to solve. Solutions primarily involve performing a sequence of elementary calculations using basic arithmetic operations (+ − ×÷) to… See the full description on the dataset page: https://huggingface.co/datasets/openai/gsm8k.

♥0
974.3k
Mar 23, 2026
Dataset
fka/prompts.chat

a.k.a. Awesome ChatGPT Prompts This is a Dataset Repository mirror of prompts.chat — a social platform for AI prompts. 📢 Notice This Hugging Face dataset is a mirror. For the latest prompts, features, and community contributions, please visit: 🌐 Website: prompts.chat 📦 GitHub: github.com/f/awesome-chatgpt-prompts About prompts.chat is an open-source platform where users can share, discover, and collect AI prompts from the community. The project can… See the full description on the dataset page: https://huggingface.co/datasets/fka/prompts.chat.

♥0
27.4k
Oct 26, 2026
Dataset
Open-Orca/OpenOrca

🐋 The OpenOrca Dataset! 🐋 We are thrilled to announce the release of the OpenOrca dataset! This rich collection of augmented FLAN data aligns, as best as possible, with the distributions outlined in the Orca paper. It has been instrumental in generating high-performing model checkpoints and serves as a valuable resource for all NLP researchers and developers! Official Models Mistral-7B-OpenOrca Our latest model, the first 7B to score better overall than all… See the full description on the dataset page: https://huggingface.co/datasets/Open-Orca/OpenOrca.

♥0
13.0k
Feb 19, 2025
Dataset
tatsu-lab/alpaca

Dataset Card for Alpaca Dataset Summary Alpaca is a dataset of 52,000 instructions and demonstrations generated by OpenAI's text-davinci-003 engine. This instruction data can be used to conduct instruction-tuning for language models and make the language model follow instruction better. The authors built on the data generation pipeline from Self-Instruct framework and made the following modifications: The text-davinci-003 engine to generate the instruction data… See the full description on the dataset page: https://huggingface.co/datasets/tatsu-lab/alpaca.

♥0
82.0k
May 22, 2023
Dataset
stanfordnlp/imdb

Dataset Card for "imdb" Dataset Summary Large Movie Review Dataset. This is a dataset for binary sentiment classification containing substantially more data than previous benchmark datasets. We provide a set of 25,000 highly polar movie reviews for training, and 25,000 for testing. There is additional unlabeled data for use as well. Supported Tasks and Leaderboards More Information Needed Languages More Information Needed… See the full description on the dataset page: https://huggingface.co/datasets/stanfordnlp/imdb.

♥0
173.4k
Jan 4, 2024
Dataset
nyu-mll/glue

Dataset Card for GLUE Dataset Summary GLUE, the General Language Understanding Evaluation benchmark (https://gluebenchmark.com/) is a collection of resources for training, evaluating, and analyzing natural language understanding systems. Supported Tasks and Leaderboards The leaderboard for the GLUE benchmark can be found at this address. It comprises the following tasks: ax A manually-curated evaluation dataset for fine-grained… See the full description on the dataset page: https://huggingface.co/datasets/nyu-mll/glue.

♥0
673.4k
Jan 30, 2024
Dataset
proj-persona/PersonaHub

Scaling Synthetic Data Creation with 1,000,000,000 Personas This repo releases data introduced in our paper Scaling Synthetic Data Creation with 1,000,000,000 Personas: We propose a novel persona-driven data synthesis methodology that leverages various perspectives within a large language model (LLM) to create diverse synthetic data. To fully exploit this methodology at scale, we introduce PERSONA HUB – a collection of 1 billion diverse personas automatically curated from web… See the full description on the dataset page: https://huggingface.co/datasets/proj-persona/PersonaHub.

♥0
4.6k
Sep 26, 2025
Dataset
Salesforce/xlam-function-calling-60k

APIGen Function-Calling Datasets Paper | Website | Models This repo contains 60,000 data collected by APIGen, an automated data generation pipeline designed to produce verifiable high-quality datasets for function-calling applications. Each data in our dataset is verified through three hierarchical stages: format checking, actual function executions, and semantic verification, ensuring its reliability and correctness. We conducted human evaluation over 600 sampled data points… See the full description on the dataset page: https://huggingface.co/datasets/Salesforce/xlam-function-calling-60k.

♥0
17.7k
Jan 24, 2025
Dataset
wikimedia/wikipedia

Dataset Card for Wikimedia Wikipedia Dataset Summary Wikipedia dataset containing cleaned articles of all languages. The dataset is built from the Wikipedia dumps (https://dumps.wikimedia.org/) with one subset per language, each containing a single train split. Each example contains the content of one full Wikipedia article with cleaning to strip markdown and unwanted sections (references, etc.). All language subsets have already been processed for recent dump… See the full description on the dataset page: https://huggingface.co/datasets/wikimedia/wikipedia.

♥0
289.7k
Jan 9, 2024