Profile-Driven User Simulation via Reinforcement Learning with Hierarchical Rewards for Task-Oriented Dialogues
Summary
The paper proposes ProfileSim, a profile-driven user simulation framework for financial marketing outbound calls, using GRPO with hierarchical rewards and jointly modeled user/business profiles to generate realistic, compliant dialogue data for task-oriented dialogue systems.
Similar Articles
@alacheng: The DeepSeek V4.1 flash 1017 update mentions a Reinforcement Learning (RL) training technique based on self-feedback. Reinforcement Learning with Self-Feedback means: during RL training, instead of relying entirely on external "ground truth" or human-annotated rewards…
The article unpacks the "Reinforcement Learning with Self-Feedback" technique mentioned in the DeepSeek V4.1 flash update, explains how it provides denser reward signals for long-horizon agent tasks that lack ground truth answers — such as "wish-based programming" — and compiles a list of 10 papers on self-feedback reinforcement learning from 2024–2026.
@NFT_Chen: This is incredible! Agent interactive RL is finally out of "engineering hell"! HarborRL open-sources a full framework enabling real coding agents to do stable RL! The hardest part of training agents with RL was never the algorithm — it was the engineering nightmares: trajectory collection, token alignment, multi-turn tool calls, policy version consistency. HarborRL solves all of them as a reproducible pipeline.
HarborRL has open-sourced a lightweight agent reinforcement learning framework that integrates model serving, trajectory generation, tool execution, verifier-based rewards, and policy updates into a reproducible pipeline. It supports flexible combinations of Qwen/GLM models × GRPO/DAPO algorithms × 200+ sandbox tasks × 40+ agent harnesses (such as Claude Code and SWE-agent).
CPT’d Qwen9B on Polish legal data. How to make it chat? IMPORTANTLY: how to make it reason? and function call in my harness? and which to do first? [D]
A developer building a Polish legal domain model describes three stages of continued pretraining on Qwen3.5-9B-BASE and asks the community how to best use their remaining data (legal Q&A, study materials, harness conversations) to add chat ability, chain-of-thought legal reasoning, and function-calling for their in-house AI law harness — specifically where SFT versus RL fits in.
@benbye: I trained a 750K-parameter world-model agent on my M5 Pro to play video games! Presenting NanoDreamer: a tiny Dreamer-i…
Benjamin Bai unveils NanoDreamer, a 750K-parameter Dreamer-inspired world-model and actor-critic agent trained entirely on a MacBook M5 Pro, complete with his own autograd engine, tensor library, and transformer, playing all 5 MinAtar games from imagination.
@SergioPaniego: how do you post-train an agent? we laid it out as a 5-step curriculum, from SFT to RL through a real harness, with live…
Hugging Face published a 5-step curriculum for post-training AI agents, covering SFT, distillation, GRPO-based RL, RL environments, and harness-scale training with livestreams, code, and docs for each step.