← All proposals
Illustration: Societal decision-support concept: Public services, made clear

Understanding public-service guidance

Help readers find the correct passage in NAV’s financial-assistance guidance.

Download brief

Technical

Bachelor’s · applied project

Final result

Search prototype, test questions and usability findings.

01

Dataset + material

NAV guidance + 40 labelled questions

finalise expanded sections and paragraph IDs. Write 30 answerable/10 out-of-scope questions. Split by intent: development 7/3; held-out 23/7. Independently check acceptable passages.

02

What to do

  • Build a BM25 paragraph search over the specified NAV page.
03

How it is tested

Use the fixed page and labelled questions; check retrieval hits and observe adults finding the correct source paragraph. Plan 4 participant sessions.

04

Before you start

Example tools · Python, BM25 library, Streamlit These are suggestions; equivalent tools are fine.

Access or people · Recruit Norwegian-reading adults and an independent key reviewer; NAV staff access is unnecessary.

Research method · Build and test · 6 steps
  1. Read the starting sources and choose one established implementation method.
  2. Write the requirements, data fields, system diagram and test cases.
  3. Prepare NAV guidance + 40 labelled questions. Make the answer key and pass criteria before testing.
  4. Build a working version of search prototype, test questions and usability findings.
  5. Run function, integration and failure-case tests. Record each result.
  6. Run the practical evaluation and list the changes the system still needs.
Download the complete bachelor planDownload bachelor instructions

Master’s · research project

Final result

Search prototype, question set and retrieval comparison.

01

Dataset + material

NAV guidance + 40 labelled questions

finalise expanded sections and paragraph IDs. Write 30 answerable/10 out-of-scope questions. Split by intent: development 7/3; held-out 23/7. Independently check acceptable passages.

02

What to do

  • Hash the NAV HTML snapshot, assign stable paragraph IDs and implement one shared tokenizer for overlap and BM25 (k1=1.2, b=0.75) retrieval.
  • finalise the 7/3 development and 23/7 held-out answerable/out-of-scope split; tune abstention only on development intents against an reviewed passage key.
  • Verify snapshot/index reproducibility; report hit@1/3, MRR, false acceptance/refusal and coverage separately from comprehension and source-opening behaviour.
03

How it is tested

BM25 versus term-overlap search with identical processing and interface. On the held-out set report hit@1, hit@3, MRR, answerable-query coverage, out-of-scope false acceptance and answerable false refusal separately. Twelve Norwegian-reading adults complete 8 non-overlapping tasks, 4 per mode; measure comprehension, source checking, time and unsupported reliance.

04

Before you start

Example tools · Python, BM25 library, Streamlit These are suggestions; equivalent tools are fine.

Access or people · Recruit 12 Norwegian-reading adults and an independent key reviewer; NAV staff access is unnecessary.

01—03

Start with these three actions

  1. Save a dated NAV page snapshot and split it into numbered paragraphs.
  2. Write 5 answerable and 2 out-of-scope questions; ask a second reader to label the matching passages.
  3. finalise the question split, build keyword search, then add BM25 without consulting held-out answers.
Files, questions and sources

Pilot question: Does ranked, source-linked paragraph retrieval help readers find supported answers in NAV guidance?

Literature search: public service information retrieval citizen comprehension

Download starter instructions
Research method · Design, build and test (DSR) · 7 steps
  1. Read the newest papers and list the closest existing systems.
  2. Write down the versions, fields, data split, case assignment, random seeds and correct answers for NAV guidance + 40 labelled questions.
  3. Draw the user workflow, data model and system architecture. List the requirements and pass criteria.
  4. Build a working version of search prototype, question set and retrieval comparison.
  5. Test every function, connection and failure case. Save the failed tests as well as the passed tests.
  6. Compare the system with the named alternative. Then run the user task or decision task in the assignment.
  7. Report the measured result, the failed cases and the design lessons another team can reuse.
Research question and sources

Research question: Investigate retrieval failure and abstention for Norwegian public-service questions. Compare term overlap and BM25 on answerable/unanswerable intents; study how source presentation affects successful information finding without inventing answers.

Research result: A specific evaluation of retrieval and evidence-use failures, with design implications.

Current project literature

IS theory starting points

Search Scopus or Web of Science and ACM Digital Library using the topic query, then follow citations to the thesis start date. Record searches and compare methods, data, findings and limitations in literature-matrix.csv. Use that review to confirm or revise the gap and choose a current comparator. The linked papers are starting points.

Search terms: public service information retrieval citizen comprehension

Non-technical

Bachelor’s · applied project

Final result

A ranked list of concrete page changes.

01

Dataset + material

NAV guidance + 8 task cards

Create tasks about required documents, application steps and finding human contact.

02

What to do

  • Identify obstacles when users look for information on the NAV page.
03

How it is tested

Run task walkthroughs on the existing page; group failures by wording, navigation and missing context. Plan 4 participant sessions.

04

Before you start

Example tools · LibreOffice Writer/Calc, audio recorder with consent; no programming required. These are suggestions; equivalent tools are fine.

Access or people · Recruit readers and obtain an independent answer-sheet review.

Research method · Study and improve · 6 steps
  1. Read the starting sources and write the exact information problem.
  2. Prepare NAV guidance + 8 task cards and a separate answer sheet or coding sheet.
  3. Run one pilot and fix unclear questions.
  4. Collect the named evidence with consent.
  5. Group the findings with the stated categories and check the answer sheet.
  6. Produce a ranked list of concrete page changes. List the three most useful changes.
Download the complete bachelor planDownload bachelor instructions

Master’s · research project

Final result

Eight task results and a prioritised list of page improvements.

01

Dataset + material

NAV guidance + 8 task cards

Create tasks about required documents, application steps and finding human contact. Recruit 12 adult readers; collect no benefit applications.

02

What to do

  • Use the existing NAV page and fictional information-seeking questions.
  • Observe where readers look and ask them to explain the answer in their own words.
03

How it is tested

Think-aloud sessions; score passage finding and comprehension against a reviewed answer sheet. Code navigation and wording problems.

04

Before you start

Example tools · LibreOffice Writer/Calc, audio recorder with consent; no programming required. These are suggestions; equivalent tools are fine.

Access or people · Recruit readers and obtain an independent answer-sheet review.

01—03

Start with these three actions

  1. Prepare a pilot with 2 examples from: NAV guidance + 8 task cards. Write the task questions and a reference answer sheet.
  2. Write a recruitment message, information sheet and consent form for the participants named above. Agree privacy handling with the supervisor before contact.
  3. Pilot one session after approval; revise unclear questions, finalise the task sets and coding categories, then recruit the planned sample.
Files, questions and sources

Pilot question: Which parts of the guidance prevent readers from finding and explaining the next step?

Literature search: public service information retrieval citizen comprehension qualitative scenario study

Interview prompts

  • Show the passage that answers this task.
  • Explain the application step in your own words.
  • Where would you seek help if the page does not answer it?
Download starter instructions
Research method · Study, compare and explain · 7 steps
  1. Read the newest papers and write one exact research question.
  2. State which people, cases or documents you will study and what you will compare.
  3. Write the selection rules, questions and analysis steps for NAV guidance + 8 task cards.
  4. Run one pilot. Fix unclear questions or categories, then keep the guide unchanged.
  5. Collect the named interviews, cases or documents with consent.
  6. Analyse them with the stated comparison or coding method. Keep disagreements and missing data.
  7. Report the answer, the evidence and the practical output named in the assignment.
Research question and sources

Research question: Explain why some users cannot turn located information into an answer. Separate navigation, terminology and task-context failures; use cognitive fit and information quality to explain contrasting cases.

Research result: A model of information-use barriers supported by task evidence.

Current project literature

IS theory starting points

Search Scopus or Web of Science and ACM Digital Library using the topic query, then follow citations to the thesis start date. Record searches and compare methods, data, findings and limitations in literature-matrix.csv. Use that review to confirm or revise the gap and choose a current comparator. The linked papers are starting points.

Search terms: public service information retrieval citizen comprehension qualitative scenario study

Your degree, track and shortlist are saved in this browser.