Skip to content
Skip article header Healthcare

AI Citation UX for Aesthetic Medicine: Our Mockups Hallucinated Before the Model Did

Before any model wrote an answer, our own mockups had invented citations. We redesigned an aesthetic-medicine learning platform so that every claim cites a printed page and every gap in its knowledge becomes a designed screen.

28 min read 56 views
An illustrative AI answer screen with a cited summary, three source classes and feedback controls
Skip key takeaways
  • Claim-level citations In the design, each claim in an answer cites a page the reader can open.
  • Design-time hallucination Placeholder citations in mockups are a real risk: our audit found 6 of 7 demo citations wrong and 4 invented.
  • Designed refusals Honesty states belong on designed screens, not in error toasts.
  • AI-assisted speed AI assistants turned what usually takes weeks of document review and concept design into 42 elapsed hours by our commit history, while human decisions and automated checks kept that speed honest.

Before any model wrote an answer, our own mockups broke the product's central promise. Our audit of the demo found 6 of its 7 citations wrong, and 4 of them were invented outright.

The product is Thalvera, an AI learning platform for aesthetic-medicine and longevity clinics. In the design, every answer cites each claim to a page the reader can open, and designed screens take over when the product cannot or must not answer. A handbook, a study and a regulator never share one citation style. Document review, concept design and verification took 42 elapsed hours (by our commit history).

Names are changed. Thalvera and The Longhaven Handbook are pseudonyms, and every screen shown is an illustrative recreation in our own style, not the client's design.

Item Detail
Client An anonymous company building an AI learning platform for aesthetic and longevity practices
Product Thalvera (a pseudonym)
Our role Product discovery, knowledge engineering, UX and UI design, review deployment
Inputs 8 client documents, 406 pages
Deliverables Knowledge base and decision registers; 3 UX concepts with 91 desktop screens; 42 mobile screens; 3 visual directions in light and dark themes; a password-protected review site
Timeline 42 hours from first to last commit, 22 to 24 September 2026; 12 working sessions
Status Design phase; the client is choosing a direction
Source of figures Commit history, project registers and design files as of 24 September 2026

An audit of our own mockups found 6 of 7 citations wrong

Our first concept pass filled its citation slots with plausible placeholders, and our own audit against the verified book found 6 of 7 demo citations wrong, 4 of them invented. A fake citation in a mockup is worse than obvious filler text, because it looks like the product working.

Thalvera's central promise is that every claim on screen can be traced to a printed page of The Longhaven Handbook, the practice handbook it teaches from. Our own design files broke that promise first.

We call this a design-time hallucination: invented content in a design artifact that looks like real, verified output. It needs no model, since a designer, a copywriter or an AI assistant filling a template can produce one.

Our audit covered every screen the client could see, with two methods. Pattern searches swept every screen file for page numbers above 272, Part numerals III to VI, subsection signs such as "§7.3" and the topics the book never covers. A manual check then compared each demo citation with the verified table of contents. On day one, the first pass flagged the problems. Corrections landed on day two, in a session of roughly six hours that also grew the desktop demo from 49 to 91 screens (by our commit history).

Before the fixes, our audit counted:

  • 7 demo citations: 6 wrong, 4 of them invented outright, 1 exact match.
  • 19 page references beyond the last printed page, 272. The highest was p. 402.
  • 59 references to Parts III to VI of a two-Part book.
  • 186 numbered subsections such as "§7.3", in a book that has none, which made phantom numbering the largest error class.
  • 4 invented quotations, one under "Review: Approved · clinical reviewer".
  • A version stamp of "v1.0", borrowed from a roadmap document.
  • Three topics the book never mentions, chromophore competition, priming and a device utilization model, each cited by the demo although it appears zero times in the book.

Obvious filler text is honest about being fake. A placeholder citation with a page number and a review status can be carried into a meeting as evidence. Large firms have already published fabricated references. In October 2025 Deloitte agreed to repay part of an A$440,000 government contract after its report was found to contain a fabricated court quote and references to nonexistent research papers (AP). Its refund came to more than A$97,000 (CFO Dive). In May 2026 EY Canada removed a report it had published in 2025 after GPTZero found that 16 of its 27 references were hallucinated (Consulting.ca).

Our fix had four parts:

  1. One source of quoted text. 106 passages verified on their printed pages, 64 clinical and 42 business, are the only text the demo shows as the book's own words (by our book verification).
  2. Absent topics route to a designed screen. Such a question goes to "Not in the source", never to a nearby chapter.
  3. Honest review labels. "Approved" may appear only above verbatim text.
  4. A recount. By our recount at the latest commit, the desktop demo has zero out-of-range pages, zero phantom Parts and zero subsection numbers; the mobile screens are next.

We also specified seven assertions the book-ingestion pipeline must pass before any answer ships (in our book verification report), from no control bytes in any chunk to printed page equal to PDF page minus 13 for every chunk. They belong to the product build and are not running yet.

Our rule from the audit is "Never fake a citation": if content is not real, it must look unreal. A placeholder citation needs a dashed outline and the word SAMPLE, never a page number that merely looks right.

A demo citation before the audit, pointing to a nonexistent page, and after it, pointing to a verified printed page
Before and after the citation audit. Illustrative recreation, not the client's design; page numbers and text are schematic.

We verified the source book page by page before trusting a single citation

Our book verification read The Longhaven Handbook page by page: 285 PDF pages, printed body pages 1 to 272 and a fixed offset of 13 between them. Every citation in the design now follows the book's real structure, with printed pages and no invented subsection numbers.

We checked the file the way a retrieval model will ingest it. It is born-digital, created in a word processor rather than scanned (in our book verification). In its roman-numbered front matter, each numeral equals its PDF page. Body pages run from printed page 1 to 272, each equal to its PDF page minus 13, an offset we checked at all 272 body pages rather than at a sample. The book's table of contents now serves as a regression fixture, a structure any future ingestion must reproduce exactly.

Some figures carry labels that exist only as pixels, invisible to text extraction, so we asked the client for the source files instead of guessing.

Its structure is asymmetric. Part One is a sequence of numbered frameworks with no chapters. Part Two divides into sections whose chapters are numbered continuously across the whole part. Nothing is numbered below that level: a search for N.N patterns returns zero matches across all 285 pages.

That settled the citation format. A printed-page citation is a reference that names the part, the section (Part Two only), the unit title, a named heading from the page and the page number printed on it, so a reader holding the book can find the passage. It never carries an invented subsection number or a PDF page. In schematic form:

Part Two · Section [n] · [unit title] · [named heading] · p. [printed page]

Our guide to the RAG data pipeline covers the same discipline inside ingestion, where page mapping and chunk boundaries decide what a model can cite.

Trust in a medical AI product is a chain of seven design decisions

A medical AI product earns trust through seven linked design decisions, from tracing each requirement to its source to gating every output of the process. A weak link anywhere breaks the promise that every claim can be checked.

Aesthetic medicine raises the stakes. Everyday questions touch complications, device indications and marketing claims, and an untraceable answer can travel from a screen into a treatment room or onto a practice website. Marketing is already a weak spot: a 2024 study of 200 US practice websites found that 103 of them (51.5%) made at least one off-label claim about energy-based devices, measured against FDA-approved indications. Any AI for aesthetic medicine enters that environment and has to show where every claim comes from. For the wider field, read our guide to AI in healthcare in 2026.

Thalvera is our client's answer to that problem. It is a source-grounded AI learning platform: a product that answers and teaches only from sources it can name and shows the reader where each statement came from. Its first source is one practice handbook, The Longhaven Handbook, registered in the design as Corpus A and joined there by FDA records and external research from PubMed and ClinicalTrials.gov. Three promises follow: every claim carries its provenance, uncertainty stays visible and the product teaches rather than prescribes.

Our knowledge base counts 10 user types. Three role-based personas, all fictional, carry them through the design: a physician between patients, an aesthetician learning a technique and a practice owner planning investments.

We call the sequence behind every answer a trust chain: the ordered set of design decisions that lets a reader follow any claim on screen back to a verified source. Each link depends on the one before it, and a perfect citation marker is worthless if it points at a page nobody checked.

  1. Requirements: Trace every requirement to its source document, and list the documents your specification leaves out.
  2. Source: Verify the source page by page before any interface cites it.
  3. Artifacts: Audit your own mockups and demos for invented citations, because a design artifact can hallucinate as easily as a model can.
  4. Answers: Cite every claim.
  5. Limits: Give every refusal, withheld claim and clarifying question a full designed screen with a next step.
  6. Provenance: Keep the handbook, external studies and regulatory records in separate classes, each with its own citation format.
  7. Process: Put a human decision and an automated check behind every fast output.
Seven linked steps from requirements to process, each a design decision behind a verifiable AI answer
The trust chain behind Thalvera's answers. Illustrative diagram by Pharos Production, not the client's design.

Our working spec was built from three of eight documents

The working specification we started from compiled three of the client's eight documents and carried nothing from the roadmap, the safety framework, the visual strategy or the book itself. Tracing every requirement back to all eight exposed gaps in the first answer design.

All 8 client documents total 406 pages (in our project register). By our requirements trace, the first answer design covered half of the components the safety framework requires and had 7 honesty states, screens for non-answers and limits, while the documents call for 11 more, led by an emergency-escalation state.

So we read all eight documents and built a register instead of a summary. In our decision register it now holds:

  • 156 client decisions, each with a page reference
  • 64 contradictions, 46 between documents and 18 inside single documents
  • 89 prohibitions
  • 63 glossary terms
  • 31 questions for the client (5 blocking, 18 important, 8 confirmations), plus 3 requests for material

Three rules keep the register honest. Client decisions and our own live in separate ledgers that are never merged; the team ledger holds 8 decisions so far (in our decision register), so anyone can see which choices the client never made. Every claim in the knowledge base carries a page reference to a client document or the label "inference" or "ruling". Old entries are never rewritten: a correction is appended as a dated note under the original.

Three UX concepts let the client compare products, not screens

We designed three complete UX concepts, each with a different home screen, so the client could decide what kind of product Thalvera should be before debating layouts. All three share one answer card, one evidence panel and the same honesty states.

A single concept invites feedback on pixels, while three home screens force a product decision: Thalvera could be a place to ask, a place to read or a place to learn.

Concept Home screen Best for Strength Risk Screens, in our design files
A · Ask-first Ask is home A physician between patients Fastest route to a cited answer Reads as a chatbot; learning never starts if nobody asks 32
B · Book-first Library and reader are home; the assistant docks to the open chapter and citations highlight lines on the page Aestheticians, students and faculty Strongest fit with the MVP scope Reads as a PDF viewer; whole-book questions need an exit from chapter scope 30
C · Learning-path-first A personal learning map is home; Ask and Library are tools inside it; a baseline test shows the gap between confidence and performance Learners with a goal Socratic "Teach Me" and "Test Me" with a confidence slider Heaviest first run; may oversell later-phase features 29

A citation behaves the same way whichever door the reader came through, and every MVP user story appears in at least one concept, so the comparison covers scope as well as layout.

Our recommendation is concept A's shell with concept B's reader: Ask-first gives the physician speed, and the docked reader keeps the book one click away. Concept C, which leans on later-phase features, stays as a later direction. The client decides, and nothing here is approved yet.

Three full concepts cost more than one polished concept, but they surface disagreements about the product while changes are still cheap. Our comparison of PoC, MVP and prototype sets out what each stage should prove.

A verifiable AI answer has eight parts

Citation UX for a verifiable AI answer comes down to eight parts: a header with role and source stamp, a summary, source classes, claim-level citation markers, limitations, a next step, feedback controls and footer metadata. Each part answers a question a careful reader asks before trusting the text.

Its core unit is the claim-level citation: a citation attached to one specific claim inside an answer, which opens the exact supporting passage instead of listing sources at the end. If an answer makes four claims, it carries four markers.

These eight parts, numbered in our design spec, are the card's own anatomy, a different list from the components the client's safety framework requires:

  1. Header. A role chip reads "Answering as: Physician" and the corpus stamp names the source and its edition. A depth control (Explain simply, Standard, Go deeper) changes depth and language, never the passages.
  2. Summary. Two to four sentences that answer the question directly.
  3. Source classes. Fixed columns, never merged, with the book first. Each shows one state (found, no match, not applicable or unavailable), and only "unavailable" is grayed out.
  4. Claim-level citation markers. One per claim, each opening the evidence panel at its passage.
  5. Limitations. A band on every substantive answer that says what it cannot claim, such as sources differ or awaiting clinical review.
  6. Next step. One lesson plus up to three secondary actions, so the answer ends in a route instead of an endless chat.
  7. Feedback. Six controls in a fixed order.
  8. Footer meta. Answer version, model version, retrieval date and "no PHI stored", a label that states a promise the build must keep and makes no compliance claim.

In the design, the evidence panel comes in three densities: a rail beside the answer, a popover on the marker and an open panel. At every density it shows class, location, verbatim passage, edition, evidence type, review status, retrieval date and the claims it supports.

Our demo's hero answer corrects the premise of its own question inside the limitations band, on purpose: nothing shows visible uncertainty more clearly than an answer that says the question assumed something the source does not say.

Six feedback controls always appear in the same order, so a practitioner finds the right one without reading the row. In the design, Helpful and Not helpful rate the answer as a whole. Incorrect opens a content fix against the cited passage. Outdated triggers a freshness check on the source and its edition, while Missing source records a coverage gap, a question the corpus cannot yet answer. Request expert review queues the answer for a human expert.

None of this starts from zero. The Nielsen Norman Group's piece on AI hallucinations and the citations pattern in Shape of AI are good starting points for showing sources; this case adds the regulated-domain version, with printed-page citations, full-screen non-answers and an audit of our own design artifacts. Retrieval engineering that fills these slots with real passages is the work of our RAG knowledge systems practice.

An AI answer card with eight numbered parts, from role chip to footer
The eight parts of a verifiable answer. Illustrative recreation, not the client's design.

Honesty states are designed screens, not error toasts

Honesty states are how the design handles AI abstention: a full screen with a next step for every moment the product must refuse, withhold or ask back.

An honesty state is a designed part of the interface that tells the reader what the product searched and what it cannot or must not say, together with a next step. Unlike a toast, it stays on screen and offers a route. Of the seven designed so far (in our design files), five are full screens that replace or reduce an answer: not in the source, educational boundary, claim withheld, clarify and source updated. The other two, transparent retrieval and limitations, ride on every answer.

State Trigger What the design shows Why it matters
Transparent retrieval Any answer Named retrieval steps, including "Premise checked" The search is visible, not only the result
Not in the source No passage supports the question "Searched 100% of Corpus A · 0 passages", the nearest covered chapters and "Request this topic" Nothing is assembled from adjacent material
Educational boundary A patient-specific question A refusal plus what the product can teach instead No settings, doses or treatments for a specific patient
Limitations Every substantive answer What the answer cannot claim Uncertainty stays visible
Claim withheld One claim cannot be traced 3 of 4 claims shown; the fourth goes to review Untraceable to the book, not judged false
Clarify An ambiguous question A question back before answering No guessing
Source updated The source changed after the answer was saved The saved answer, kept, labeled and comparable side by side Nothing is rewritten silently

"Not in the source" states its search in numbers, which tells the reader the product looked everywhere it is allowed to look. Its nearest covered chapters give a path forward, and "Request this topic" turns the gap into a signal for whoever maintains the content.

An educational boundary refuses the patient-specific part of a question and keeps the teachable part: a physician who asks for one patient's device setting gets none, only what the book teaches about that kind of decision.

Claim withheld is the least familiar. An answer can go out with three traceable claims while a fourth waits for review, labeled as untraceable to the book rather than false, so a traceability gap never reads as a medical verdict.

An honesty state can be wrong too. A retrieval miss would show "Not in the source" for a topic the book does cover, a false refusal that looks like honesty. In the design, the three absent topics from our audit act as known negatives: they must always land on that screen, and covered topics must never land there. "Request this topic" doubles as a way for a reader to report a miss. Tests for both directions belong to the product build.

We prefer evidence labels to a model-confidence score. A confidence score describes the model's certainty, while a tier, like the maturity label planned for the design, describes evidence the reader can open and check.

Three honesty-state screens: not in the source, educational boundary and claim withheld, each with a next step
Three of the seven honesty states: not in the source, educational boundary and claim withheld. Illustrative recreation, not the client's design.

One answer can hold three kinds of truth

A single answer can draw on the handbook, external research and FDA records, so the design keeps those three source classes visibly separate, each with its own citation format and chip. No class may borrow another's authority.

The client's source policy ranks evidence in tiers, and the interface shows three classes that are never merged. At Tier 1 sits the book, The Longhaven Handbook. FDA and regulatory records (Tier 2) show what a regulator has cleared, approved or warned about. External evidence in the lower tiers covers a synthesis, a primary study or a registered trial. Regulatory records come from the US FDA only; other jurisdictions are out of scope for now.

Each class cites differently: a book citation is a printed-page citation, while an external or FDA record cites an identifier (a PMID, a DOI, an NCT number or a 510(k) number) plus publication and retrieval dates, so a reader can tell the class of a source from its citation alone.

The design also separates sources the product retrieves from sources that shape it. Three retrieval connectors appear in it: PubMed through NCBI E-utilities, openFDA's 510(k) endpoint and the ClinicalTrials.gov API v2. AHRQ evidence reports are ingested as documents, while FDA digital-health guidance, WHO guidance and the NIST AI Risk Management Framework shape the architecture and never appear as answer sources.

None of these connectors is live. In the demo every external and FDA record is a sample, with a dashed SAMPLE mark and masked identifiers, and connecting the live APIs starts with a one-day verification spike.

That off-label pattern on practice websites is why regulators get a class of their own: a cleared indication is not evidence for an advertised use.

Color means provenance and nothing else

Provenance-only color is the rule that the interface's single accent color marks the book and nothing else. Role chips, depth controls and the brand mark stay neutral, the FDA chip is solid ink and external evidence gets an outlined chip that carries its tier, so a reader who learns the rule once can read provenance at a glance.

When sources disagree, the interface does not pick a winner

When external evidence and an FDA record disagree, a "Sources differ" block in the design shows them side by side, each under its own chip. The regulator takes precedence on regulatory status only; on what a study found, the study speaks for itself. Our demo uses exosomes, a frontier topic where the regulator's position is plain: FDA states that "There are currently no FDA-approved exosome products." A sample study record can sit beside that statement without either one being edited to agree.

The color rule survives the dark theme

We drew three visual directions of one answer screen. Every color and typeface is a token on the frame root, so a dark theme is a second set of token values over markup reused byte for byte. Of the three dark strategies, an inverted page makes the reading surface the darkest layer, layered surfaces make each nested layer a step lighter than its parent and the third relies on soft elevation. Any strategy pairs with any direction, for 12 frames, 6 light and 6 dark (in our design files).

Contrast was measured after compositing semi-transparent washes onto their real backgrounds. By our rule checker, run on 24 September 2026, the lowest text contrast per dark strategy is 5.0:1, 4.9:1 and 4.7:1, above the WCAG 4.5:1 minimum. On dark surfaces the accent keeps its hue and single meaning, so provenance reads the same in both themes, and the choice of direction and strategy stays with the client. Our UX/UI design cost guide breaks down what drives the price of this kind of exploration.

A medical learning AI must know what it will never say

Our decision register holds 89 prohibitions drawn from the client's documents, from diagnoses and doses to invented citations and unsupported FDA claims. The design turns them into visible structure, so a clinician can review the basis of every answer and keep the judgment their own.

They fall into four groups. Clinical prohibitions rule out diagnoses, doses, device settings and patient-specific treatment plans. Citation prohibitions rule out any invented citation, PMID, DOI, clearance, guideline or result. On the regulatory side, no "FDA cleared" or "approved" claim may appear without an FDA source, and a trial registration is never presented as evidence of a result. Source rules keep the book from being presented as FDA clearance or as independent evidence.

That on-screen structure lines up with how FDA describes non-device clinical decision support. FDA's Clinical Decision Support Software guidance, issued January 6, 2026 and reissued January 29, 2026, says a non-device CDS function must "enable HCPs to independently review the basis for the recommendations presented by the software so that they do not rely primarily on such recommendations, but rather on their own judgment" (PDF, p. 14). FDA also does not count software for critical, time-sensitive decisions as meeting that criterion.

In the design, the reviewable basis is concrete: claim-level citations show where each statement comes from, transparent retrieval shows what was searched, the limitations band shows what the answer cannot claim and the role chip shows who the answer was written for. None of this is a regulatory determination; it records design intent for an educational product that teaches rather than recommends treatment.

Two pieces are not designed yet. An evidence-maturity chip with three values, Established, Emerging and Frontier, is independent of the tier: a Tier 1 claim from the handbook can still be Frontier, and the reader deserves to see both facts. An emergency-escalation state for events such as vascular occlusion, visual symptoms after filler or anaphylaxis can get its layout now, while its words and its destination belong to the client's clinical lead. For the organizational side of written limits and named owners, see our AI governance framework.

AI assistance turned weeks of document review and concept design into 42 hours

Discovery and prototyping usually take weeks, and much of that calendar time is desk work. AI assistants compressed the desk work here, while every step that depends on people kept its own pace.

Paid discovery takes 2 to 4 weeks on our UX/UI design services engagements, and wireframes and prototyping add 3 to 5 weeks by Ramotion's 2026 estimate; the UK government's service manual calls 4 to 8 weeks typical for a discovery alone (GOV.UK). Much of that calendar time is desk work (reading, reconciling, drawing and checking), exactly what AI assistants accelerated here. In this engagement the desk work took 42 elapsed hours, from 22 to 24 September 2026, with 69 commits across 12 working sessions (by our commit history and changelog).

Work that depends on people did not compress. The client's answers to our 31 open questions, user research and usability testing still run on calendar time, and all three are still ahead.

Day and time (UTC+3) Milestone
22 Sep, 15:42 First commit: initial concepts and working spec
22 Sep, 22:49 Knowledge base from 8 documents
23 Sep, 08:04 Handbook verified page by page; earlier findings retracted
23 Sep, 14:36 Desktop demo grows from 49 to 91 screens, every citation checked (about six hours, 39 commits)
23 Sep, 20:33 All three source classes shown in the demo, with sample records
23 Sep, 23:17 Password-protected review site with 59 automated tests (under three hours)
24 Sep, 02:34 Three visual directions
24 Sep, 08:50 Dark themes, WCAG AA checked
24 Sep, 09:54 Last commit

AI assistants read and cross-referenced all eight documents, drafted the registers, generated and revised screens, wrote the tooling and ran the checks. People made every decision, ruled on every conflict between documents and accepted or rejected every change.

Speed has a side effect. When a screen costs minutes, a plausible placeholder costs nothing, and fast first passes are exactly where fake citations creep in. That is why the gates mattered as much as the speed. We bring the same way of working to AI product engineering.

Timeline from first to last commit, with nine milestones from 22 to 24 September 2026
The engagement's elapsed hours, drawn from our commit history. Illustrative chart by Pharos Production.

Quality gates kept the speed honest

Every fast output passed an automated gate before anyone relied on it: byte-exact sync, a rule checker, headless layout checks and a tested review deploy. Automation caught what speed let through.

Each concept exists twice, as a design-canvas file and as a static HTML copy that opens in any browser and can be checked headlessly. A sync tool refuses to write unless the round trip is byte-exact, and only one side may change between two syncs, a rule dating from the session when the canvas fell 42 frames behind (in our project records).

A rule checker verifies canonical strings, token polarity and WCAG AA contrast, and its 30 unit tests pass (by our test run of 24 September 2026). Headless frame fitting makes sure nothing clips, no frame carries more than 160 px of empty space and full-width screens stay at least 1440 by 900. A visual lint catches text outside frames, collisions and squeezed columns.

Mobile screens are generated, not drawn: a Python generator with shared tokens and component constructors produces 29 planned screens plus 13 added after an audit against the user stories (in our design files). Nobody edits a screen by hand, so one constant changes the corpus stamp everywhere.

Our review deploy fails closed. Its static demo runs on a Cloudflare Worker behind HTTP Basic Auth, answers 503 if its secrets are missing, compares credentials in constant time and sends noindex and security headers. By our test run of 24 September 2026, 59 automated tests pass with 100% line and branch coverage of the Worker, and no test can reach Cloudflare. Every working session ends the same way: a dated changelog entry, a refreshed sync log, a commit and a push.

The engagement by the numbers

Every figure comes from the project's version-controlled records as of 24 September 2026, and each row names its record.

Metric Value Source
Client documents 8 documents, 406 pages Project register
Client decisions recorded 156 Project register
Contradictions found 64 (46 between documents, 18 inside one) Project register
Prohibitions 89 Project register
Questions for the client 31 Project register
Source book 285 PDF pages, printed body pages 1 to 272 Book verification
Verified passages 106 (64 clinical, 42 business) Book verification
Demo citations wrong at audit 6 of 7 (4 invented) Citation audit
Page references out of range at audit 19 Citation audit
Phantom subsection numbers at audit 186 Citation audit
Desktop screens 91 Design files
Mobile screens 42 (29 planned, 13 added) Design files
Honesty states designed 7 Design files
Visual-direction frames 12 (6 light, 6 dark) Design files
Lowest dark-theme text contrast 4.7:1 Test run, 24 September 2026
Automated tests 30 plus 59 Test run, 24 September 2026
Commits 69 Commit history
First to last commit 42 hours Commit history

What this case does not show yet

This case documents a design phase, not a product in use: nobody has tested it with users, no connector is live and the client's choices are pending.

  • No user testing yet.
  • The connectors are not live. Every external and FDA record in the demo is a sample record with masked identifiers.
  • Mobile screens still await their correction pass.
  • Neither the evidence-maturity chip nor the emergency-escalation state is designed.
  • The seven ingestion assertions are specified but not running.
  • Choices that belong to the client are pending, from the visual direction and dark strategy to the scope, so our concept recommendation remains a proposal.

Next come a one-day verification spike against the three connector APIs, the two missing safety pieces, an answer card that covers every component the safety framework requires, corrected mobile screens and the client's choice of direction and dark strategy.

Ten rules for AI answers people can verify

Ten rules from the Thalvera engagement: cite claims, cite pages a reader can open, never fake a citation, design every refusal as a screen and keep sources, colors and ledgers apart.

  1. Cite claims, not answers. Four claims deserve four markers.
  2. Cite the page a reader can open. A printed page beats a PDF offset or a chunk ID, and our minus-13 offset held at all 272 body pages because we checked every one.
  3. Never render a citation slot the source cannot fill. Our demo carried 186 subsection numbers such as "§7.3" for a book that has none.
  4. Never fake a citation. Our audit found 4 invented quotations that looked real enough to carry into a meeting.
  5. Design every "no" as a screen with a next step. Five of the seven honesty states replace or reduce an answer, and each one still offers a route.
  6. Show what was searched. "Searched 100% of Corpus A · 0 passages" is an answer in itself.
  7. Keep the book, the study and the regulator in separate classes. Off-label claims on practice websites show how easily a cleared indication and an advertised use blur.
  8. Let color mean one thing. Our accent marks the book, even in the dark theme.
  9. Never rewrite a saved answer silently. Our source-updated state keeps the old answer, labels it and shows the new one beside it.
  10. Keep the client's decisions and the team's in separate ledgers. Our 8 team decisions sit apart from the client's 156 in our decision register.

If you are building an AI product for a regulated field, we can help you design answers that cite their sources and admit their gaps. Get an AI project estimate or explore our RAG knowledge systems, UX/UI design services and healthcare IT solutions pages.

Methodology: figures come from the project's version-controlled records (commit history, decision register, book verification, design files, the citation audit and test runs) as of 24 September 2026. Times are commit timestamps in UTC+3; a window between two commits is an upper bound on elapsed time, not a measure of effort. Personas are fictional. External and FDA records in the demo are samples with masked identifiers. Thalvera and The Longhaven Handbook are pseudonyms.

FAQ

Last updated:

Quick answers to common questions about custom software development, pricing, process and technology.

  • Copy link Copies a direct link to this answer to your clipboard.

    An honesty state is a designed part of an AI interface that tells the reader what the product searched and what it cannot or must not say. Most honesty states are full screens that replace a normal answer when the product must refuse, withhold a claim or ask back.

    Each one offers a next step.

  • Copy link Copies a direct link to this answer to your clipboard.

    An assistant should state its search in numbers, for example "Searched 100% of Corpus A · 0 passages". Then it should offer a next step: the nearest covered topic, a lesson or a way to request the missing content.

    It should never stitch an answer together from adjacent material.

  • Copy link Copies a direct link to this answer to your clipboard.

    Treat every demo citation as data that needs verification. Allow only passages checked on their printed pages as quoted text, route absent topics to a "Not in the source" screen and label sample records SAMPLE.

    Then audit the finished mockups against the source before a stakeholder sees them.

  • Copy link Copies a direct link to this answer to your clipboard.

    Both sources, side by side, each under its own class label, so the reader sees the disagreement instead of one blended sentence. A regulator should win only on regulatory status, such as whether a product is approved.

    On what a study found, the study speaks for itself, with its identifier and dates.

  • Copy link Copies a direct link to this answer to your clipboard.

    Not the patient-specific part. A learning tool can explain principles, evidence and the reasoning behind a type of decision, but doses, device settings and treatment plans for one patient stay out of scope.

    In Thalvera's design an educational boundary screen declines that part and offers what the tool can teach instead.

  • Copy link Copies a direct link to this answer to your clipboard.

    The desk work behind Thalvera's design phase, document review, three UX concepts and verification, took 42 elapsed hours by our commit history. That figure covers this one project and only its desk work; the client's answers, user research and usability testing run on calendar time and are still ahead.

I work with startup founders who need a dedicated software development team but don’t want to gamble on hiring, random outsourcing, or opaque delivery.
Most founders face the same problem sooner or later.
Early technical and team decisions lock the product into tech debt, slow delivery, missed milestones and constant re-hiring. By the time this becomes visible, fixing it is already expensive.

As a CTO and software architect, I help founders design, build and run dedicated development teams that work as a true extension of the startup. Not as a black-box vendor.

My focus is on complex products where mistakes are costly:

  • Web3 and blockchain platforms
  • FinTech and regulated products
  • High-load startup systems
  • MVP → scale transitions

We don’t do body-shopping.
We don’t sell generic outsourcing.

Instead, we help founders:

  • build the right team structure from day one
  • keep technical ownership and transparency
  • scale delivery without losing control
  • avoid vendor lock-in and hidden risks

Teams are aligned with the product roadmap, business goals and long-term architecture. Not just short-term velocity.

Dmytro Nasyrov, Founder and CTO at Pharos Production
Dmytro Nasyrov Founder & CTO Let's work together!

Your business results matter

Achieve them with minimized risk through our bespoke innovation capabilities

Your contact details
Please enter your name
Please enter a valid email address
Please enter your message
* required

We typically reply within 4 hours

What happens next?

  1. Contact us

    Contact us today to discuss your project. We're ready to review your request promptly and guide you on the best next steps for collaboration

    Same day
  2. NDA

    We're committed to keeping your information confidential, so we'll sign a Non-Disclosure Agreement

    1 day
  3. Plan the Goals

    After we chat about your goals and needs, we'll craft a comprehensive proposal detailing the project scope, team, timeline and budget

    3-5 days
  4. Finalize the Details

    Let's connect on Google Meet to go through the proposal and confirm all the details together!

    1-2 days
  5. Sign the Contract

    As soon as the contract is signed, our dedicated team will jump into action on your project!

    Same day