Home › Datasets › Structured Problem Solving
Reasoning & Math PackHow to Fine-Tune an LLM for Structured Problem Solving
Breaking down complex, multi-part problems into structured steps and reasoning through them systematically.
- 323 instruction-response pairs
- Format JSONL
- Pack Reasoning & Math
- Dataset $29 one-time
$29 for the dataset. Training is priced separately by model, starting at $47.
What can this kind of fine-tuning teach an LLM?
A general-purpose model may already know some of this subject. Fine-tuning serves a different purpose: it repeatedly demonstrates the kinds of requests, response patterns, terminology, decisions and workflows you want the model to handle more consistently.
For Structured Problem Solving, the dataset focuses on breaking down complex, multi-part problems into structured steps and reasoning through them systematically. Fine-tuning shapes recurring model behavior; it does not turn the model into a live database or guarantee correctness on every new case.
What training data should cover
Useful supervised fine-tuning data should resemble the work you expect the model to perform. This Rebiha dataset's domain definition is organized around 14 coverage areas:
- breaking down a complex real-world problem into sub-problems; working through a decision with multiple competing constraints; planning a multi-step project with dependencies; diagnosing a problem's root cause systematically; evaluating trade-offs between several options
- structuring an approach to a resource-allocation problem; working through a problem with incomplete information; prioritizing tasks given competing deadlines; structuring a response to a hypothetical 'what would you do' scenario; working through a cost-benefit analysis
- breaking down a technical problem into diagnosable steps; structuring a plan to achieve a stated goal under constraints; working through a risk-assessment scenario methodically; synthesizing multiple pieces of information into one conclusion
How Rebiha prepared the training material
This page contains 323 instruction-response pairs from the existing Rebiha dataset. Its domain definition was designed around the coverage areas above so the training material spans multiple realistic tasks rather than one narrow prompt pattern.
Rebiha's broader dataset workflow uses structured quality review to help identify problems such as contradictions, unsupported claims, unsupported assumptions, calculation errors and other weak training examples. You can inspect real examples on this page before deciding whether the dataset fits your model and use case.
What is in this dataset
323 instruction-response pairs covering breaking down complex, multi-part problems into structured steps and reasoning through them systematically. Each pair is a realistic instruction with a full written response, in the JSONL format used for supervised fine-tuning. No synthetic filler, no duplicated rows.
Example pairs
Real rows from the dataset, shown in full.
I need to relocate my company’s 40-person engineering team from a cramped downtown office to a new suburban campus in 6 months, while maintaining productivity and not losing key staff. There are lease, hiring, commuting, and equipment issues. How do I break this down and attack it systematically?
Start by decomposing the relocation into five interdependent sub-problems: (1) facility readiness, (2) talent retention, (3) operational continuity, (4) logistics/infrastructure, and (5) budget/financial risk. For each, define a clear owner and a deliverable. Step 1: Facility readiness. Determine if the new campus can be fully fitted out (desks, labs, network, power, HVAC) by month 5. Create a Gantt chart with a critical path: lease signing → architectural review → permits → construction → furniture install → network certification. Add 2 weeks buffer. If any task exceeds its window, consider a phased move. Step 2: Talent retention. Survey all 40 engineers anonymously about commute tolerance, remote work preference, and dealbreakers. Use a weighted scoring matrix (e.g., commute > 45 min = 0.7 weight, desire for on-site collaboration = 0.3). Identify the top 10 flight risks. Offer targeted retention packages (stipend, hybrid schedule, or relocation assistance) before announcing the move. Step 3: Operational continuity. Map all ongoing projects to team members. Choose a move weekend with the lowest sprint impact. Plan a 3-day full remote work period around move days. Set up a temporary satellite office at the old location for any engineer who cannot commute for the first month—if budget allows, arrange a shuttle. Step 4: Logistics/infrastructure. Inventory all equipment (servers, monitors, test rigs). Schedule movers 3 weeks out. Order new furniture early (lead time 8-10 weeks). Ensure internet provider can install at new site 2 weeks before move. Assign a moving-day coordinator with a written checklist and backup for every critical system. Step 5: Budget/financial risk. Create a detailed cost breakdown: moving, new furniture, retention bonuses, shuttle, temporary office, and possible lease penalty at old site. Set aside a 15% contingency. Run a sensitivity analysis: if 5 engineers quit, what does replacement cost (recruiting + training) add? Compare that to the cost of extra shuttle service or hybrid stipends—choose the cheaper risk mitigation. Finally, synthesize all sub-plans into a single master timeline with weekly checkpoints. At each checkpoint, ask: Which sub-problem is most likely to slip? Adjust resources accordingly. Communicate the plan with a visual timeline to the team, and hold a town hall to answer concerns. The key is to treat this as five parallel workstreams with a weekly integration meeting, not as one overwhelming task.
I am choosing a new cloud provider for our startup’s data pipeline. We have three options: AWS, GCP, and Azure. Constraints: monthly budget is $5k, our team is small (5 engineers) with mostly Python experience, we need low-latency access to US East users, and we already use Snowflake. We also value ease of serverless deployment. How do I make this decision systematically?
Treat this as a multi-constraint decision. First, list all constraints and assign weights based on your stated priorities. Since you mention budget, team skill, latency, Snowflake integration, and serverless, I suggest weights: cost (0.25), operational fit/Python (0.20), latency (0.15), Snowflake integration (0.20), serverless maturity (0.20). Sum = 1.0. Next, gather objective data for each option. For cost: use each provider’s pricing calculator with your actual workload (e.g., 5 EC2-equivalent instances, 1TB storage, 1TB egress). Quote per month including Snowflake egress fees—Snowflake charges for cross-cloud data transfer. For latency, run a simple ping or TCP handshake test from a US East VPS to each provider’s US East region (e.g., us-east-1, us-east4, eastus2). For Python fit, check native support for Python SDKs, Airflow, and common libraries. For Snowflake integration, note that Snowflake runs natively on AWS and Azure; GCP requires a different deployment (Snowflake on GCP is available but less mature). For serverless, compare AWS Lambda vs GCP Cloud Functions vs Azure Functions in terms of cold start, concurrency, and Python runtime support. Now create a scoring matrix. Score each provider 1-5 for each criterion, where 5 is best. Example scores: Cost: AWS 3 (mid), GCP 4 (cheaper egress), Azure 2 (higher). Python fit: AWS 5, GCP 4, Azure 3. Latency: all likely 4-5 if you choose correct region, but test. Snowflake integration: AWS 5, Azure 5, GCP 3. Serverless: AWS 5, GCP 4, Azure 3. Multiply each score by weight and sum. For illustration: AWS = (3*0.25)+(5*0.20)+(4*0.15)+(5*0.20)+(5*0.20)=0.75+1.0+0.6+1.0+1.0=4.35. GCP = (4*0.25)+(4*0.20)+(4*0.15)+(3*0.20)+(4*0.20)=1.0+0.8+0.6+0.6+0.8=3.8. Azure = (2*0.25)+(3*0.20)+(4*0.15)+(5*0.20)+(3*0.20)=0.5+0.6+0.6+1.0+0.6=3.3. So AWS wins numerically. But do not stop there. Run a sensitivity analysis: if your team’s Python expertise is truly a bottleneck, increase that weight to 0.3 and reduce Snowflake to 0.15. Recalculate—AWS still likely wins. Also consider qualitative factors: AWS has the largest community and most third-party Terraform modules, which reduces engineering time. Finally, do a proof-of-concept (1 day) on the top two providers: deploy a simple serverless function that reads from Snowflake and measure cold start and egress cost. Then decide. Document your reasoning so future engineers know why you chose that provider. The systematic approach prevents bias and makes the trade-off explicit.
I need to plan the launch of a new mobile app for a non-profit that connects volunteers with local events. The launch is in 12 weeks. I have a small team: 1 backend dev, 1 frontend dev, 1 designer, and myself as project manager. We also need to coordinate with 3 partner non-profits for content and with a marketing volunteer for promotion. Several tasks depend on others: design must precede frontend, backend API must be ready before frontend integration, partner content is needed before app store listing, and marketing materials need final screenshots. How do I create a structured project plan with dependencies?
First, break the project into phases: discovery/design, development, content integration, testing, and launch preparation. For each phase, list tasks with estimated durations and dependencies. Let’s define tasks with IDs and durations (in workdays, assuming 5-day weeks): A. Define requirements and user stories (3 days) B. UX wireframes (5 days, depends on A) C. Visual design (5 days, depends on B) D. Backend API development (10 days, depends on A) E. Frontend screens development (10 days, depends on C) F. Frontend-backend integration (5 days, depends on D and E) G. Partner content collection (7 days, can start after A, but need partner availability) H. Content formatting and database seeding (3 days, depends on G) I. Internal testing (3 days, depends on F and H) J. Beta testing with 10 volunteers (5 days, depends on I) K. Bug fixes (4 days, depends on J) L. App store listing assets (screenshots, descriptions) (2 days, depends on E and H) M. Marketing plan finalization (2 days, depends on L) N. Submission to app stores (1 day, depends on K and L) O. Launch day prep (launch event, social media) (2 days, depends on M and N) Total calendar time cannot be sum of durations because of parallel work. Draw a dependency graph. Critical path is the longest chain: A → B → C → E → F → I → J → K → N → O. Sum durations: 3+5+5+10+5+3+5+4+1+2 = 43 workdays. With 12 weeks (60 workdays), you have slack of 17 days. But check other paths: A → D → F → I → J → K → N → O = 3+10+5+3+5+4+1+2=33 days. A → G → H → I... also shorter. So your critical path is design-frontend-integration-testing. That means design and frontend are your bottlenecks. Given small team, you need to parallelize: backend dev can start on D as soon as A is done, while designer does B and C. Frontend dev cannot start E until C is done, but can do some pre-work like setting up project scaffolding during B. Partner content collection (G) can start immediately after A because it’s external—assign a partner coordinator. Create a weekly schedule with milestones: Week 1: A done. Week 2: B done. Week 3: C done, D half done. Week 4: E starts, D done. Week 6: E done, F starts. Week 7: F done, G done. Week 8: H done, I done. Week 9: J done. Week 10: K done. Week 11: L and M done. Week 12: N and O. To handle risks: if designer slips, frontend dev can build with temporary UI, but better to add buffer. If partner content is late, you can launch with placeholder content but that harms reputation—so schedule a reminder 2 weeks before deadline. Use a simple Kanban board with swimlanes for each phase. Hold a 30-minute weekly sync to check dependencies. Also assign a single owner for each dependency: backend dev owns D, designer owns B/C, frontend dev owns E/F, you own G/H/L/N, marketing owns M/O. The structured plan gives you a clear critical path and slack, so you know where to focus your attention—not everything is equally urgent.
Who this is for
Builders who want their fine-tuned model to reliably perform this specific capability, as part of a broader assistant or agent.
Which models this works with
The dataset is plain JSONL, so it works with any instruction-tuned open model. On Rebiha you can train it directly on:
- Qwen — Qwen3.8, Qwen3.6, Qwen3.5, Qwen3, Qwen2.5, Qwen2.5-Coder
- Granite — Granite 4.1 (3B, 8B, 30B)
- OLMo — OLMo 3, OLMo 3.1
- GLM — GLM-4
- Gemma, Phi, DeepSeek, Mistral, and Llama families
Training uses LoRA, or QLoRA on a 4-bit base for larger models. Your base model's weights are never modified — training produces a separate adapter.
How it works
- Pick this dataset and a base model.
- Rebiha runs the job on a managed GPU. You set up nothing.
- Download your model: a ready-to-run GGUF, plus developer assets (adapter, tokenizer, configs).
Fine-tuning or RAG?
Use RAG when the model needs facts that change — your prices, your documents, today's inventory. Use fine-tuning when you want consistent behavior and structure without prompting for it every time. This dataset teaches the shape of this capability, not facts to look up.
How managed fine-tuning works
- Inspect the dataset examples and choose a compatible base model.
- Rebiha runs the training job on managed GPU infrastructure using LoRA or QLoRA as appropriate.
- Download portable model assets for your own workflow, including the available ready-to-run and developer outputs for the selected training path.
Fine-tuning or RAG?
Use fine-tuning when the objective is recurring behavior: response structure, domain patterns, terminology, workflow, or how the model approaches a class of requests. Use RAG when answers depend on changing or proprietary facts that should be retrieved at request time. The two approaches can also work together.
Know what goes in. Own what comes out.
You can inspect real examples before training, choose the model you want to adapt, and keep portable model assets when training is complete.
Related datasets
- General Instruction Following — 978 pairs
- Multi-Turn Conversation — 466 pairs
- Rewriting & Editing — 854 pairs
- Summarization — 781 pairs