Analytics — Performance & Progress Tracking
ES Reference: Phase 0 (INTOS-ES-P0-001) Analytics Foundation, Section 12 · Phase 2 (INTOS-ES-P2-001) User Analytics, Section 8
Overview
Analytics provides data-driven insights into your interview preparation journey. Phase 2 User Analytics expands the foundation with dedicated dashboards for application tracking, role match analysis, evidence coverage, question readiness, resume versioning, preparation activity, and competency mapping — all reconciliable to source data.
Key Principles
- All analytics are owner-scoped — you only see your own data
- Read models are rebuildable from transactions and events
- Correlation is not causation — analytics label assumptions explicitly
- No personality/protected-attribute inference — competency analytics only use your explicit data
- Analytics reconcile to source objects — counts match actual records
- Privacy-first — resume/JD text redacted from analytics payloads; no public benchmarks without consent
Analytics Dashboards
1. Main Analytics Dashboard (/dashboard/analytics)
High-level overview across all analytics dimensions.
Buttons & Actions:
| Button | Behavior |
|---|---|
| Date Range | Filter by time period |
| Export | Download analytics data |
| Refresh | Update with latest data |
| Drill into Dimension | Navigate to specific analytics dashboard |
2. Application Funnel Analytics
Track your job application pipeline from saved to outcome.
Dimensions Tracked:
| Stage | What It Measures |
|---|---|
| Saved | Jobs saved/tracked |
| Applied | Applications submitted |
| Screen | Recruiter/phone screens |
| Later Rounds | Technical, onsite, panel interviews |
| Final Round | Made it to final stage |
| Offer | Offers received |
| Outcome | Accepted / Rejected / Withdrawn |
Guardrail: Uses user-recorded stages only; no causality claims between preparation and outcomes.
3. Role Match Analytics
Requirement state distribution and gap analysis across all assessed roles.
Dimensions Tracked:
- Requirement states (STRONG_EVIDENCE, PARTIAL_EVIDENCE, etc.) distribution
- Gap types by role and seniority
- Seniority/domain alignment trends
- Assessment version and freshness
4. Evidence Analytics
Career Vault evidence coverage, quality, and reuse metrics.
| Metric | Description |
|---|---|
| Verified Coverage | Percentage of claims with verification |
| Unsupported Claims | Claims lacking evidence backing |
| Metrics Density | Evidence items with quantifiable outcomes |
| Conflicts | Conflicting evidence items requiring resolution |
| Reuse Count | Evidence items linked to multiple requirements |
Guardrail: No public benchmark or comparison without explicit consent.
5. Question Readiness Analytics
Answer preparation status across all kit questions.
| Status | Definition |
|---|---|
| Not Started | Question identified, no answer work |
| Evidence Missing | No evidence to ground an answer |
| Draft | Answer drafted, not confirmed |
| Confirmation | Answer under review/confirmation |
| Ready | Approved answer available |
| Practised | Answer used in at least one practice session |
| Approved | Final approved answer (post-practice refinement) |
Reconciles counts to actual kit questions.
6. Resume Version Analytics
Track which resume versions are associated with which applications and where they led.
Guardrail: Correlation between resume versions and outcomes, not causation.
7. Preparation Analytics
Task completion, topic focus, and preparation time metrics.
| Metric | Description |
|---|---|
| Task Completion Rate | Learning/preparation tasks completed vs. created |
| Topic Focus | Competency areas with most preparation activity |
| Streak (optional) | Consecutive preparation days (no compulsion pressure) |
Discloses data source for every metric.
8. Competency Analytics
Role-required competencies mapped against evidence and answer status.
Guardrail: No personality or protected-characteristic inference; uses only explicit career data.
9. Practice Analytics (/dashboard/practice/analytics)
Detailed practice performance analytics (Phase 2 foundations; full detail in Phase 3).
Also covered in the [[practice]] documentation.
Product Funnel (P0 Foundation)
| Funnel Step | Event |
|---|---|
| Authenticated | session.started |
| Career Input | document.uploaded / resume.selected |
| Opportunity | job.created |
| Assessment | role_match.completed |
| Preparation | kit.created / kit.ready |
| Engagement | question.opened / answer.opened |
| Progress | job.stage_changed |
Privacy & Responsible Analytics
- All analytics are owner-scoped — you only see your own data
- Resume/JD text is redacted from analytics payloads
- No public benchmarks or comparisons without explicit consent
- Opt-out available in Settings
- Analytics read models reconcile to source objects and support rebuild
- Archived/deleted inputs trigger recalculation and read-model removal
Related ES Requirements
| ID | Requirement |
|---|---|
| P0 Analytics | Product funnel: authenticated → career input → opportunity → assessment → preparation → engagement → progress |
| P2-E05 | User analytics across application, evidence, answer, resume, and preparation |
| AC-05 | Application, evidence, question, resume and preparation analytics reconcile |
Related Docs
- [[dashboard]] — Analytics complements the dashboard overview
- [[practice]] — Practice analytics are a sub-section of the practice module
- [[readiness]] — Readiness trends feed into analytics views
- [[role-match]] — Role match analytics track requirement state distribution
- [[settings]] — Analytics opt-out in privacy settings