01The challenge
Agency consultants need to follow changing Czech and EU regulations, find relevant knowledge and review internal policies. The product brings these related tasks into one application.
The UX challenge was to make a complex information workflow understandable: what changed, which sources support an answer and what still needs human judgement. A fluent AI response is not enough when the underlying evidence matters.
02My role
I owned the work from stakeholder analysis to the working application. I gathered needs, researched competing products and wrote user stories to translate business requirements into product scope.
I designed the frontend and application architecture, then implemented the product with AI assistance. My design decisions covered the boundaries between research modes, access to supporting sources and behaviour when evidence is missing.
I also created implementation tests and a separate answer-quality evaluation framework. Formal answer-quality evaluation has not yet been completed.
04The result
The agency uses the AI knowledge base and legislative and regulatory monitoring in client-project work. I delivered the product from requirements through design and implementation; the recording above demonstrates the monitoring module.
The wider application also supports online research and policy review. Development continues on scanned-PDF support, retrieval ranking and source coverage. No formal answer-quality evaluation has been completed, and no measured accuracy or time-saving result is claimed.
What I’d measure next
- Measure
- Task completion, time to verify an answer, source support and appropriate refusal.
- How
- Test representative consultant tasks: identify a relevant change, find supporting evidence and assess an answer. Observe completion, mode confusion and verification time. Separately, use expert-reviewed questions, including unanswerable cases, to score correctness and whether sources support each claim.
- Check alongside it
- This is a proposed validation plan, not a completed study. Check access-rights failures, unsupported claims, missed refusals and source coverage separately.