1 of 43

Usability Test Results -

Resume Builder PDF Template

Yuki Shimano

November, 2023

1

2 of 43

2

Table of Contents

Project Goals & scope……………………………………………………………………………………………………..1

Current templates…………………………………………………………………………………………………………4

Methodology and research plan………………………………………………………………………………….………7

Participants/User profile……………………………………………………………………………………….…………8

Overall findings……………………………………………………………………………………………………………9

Resume review process………………………………………………………………………………………….………10

Positive resume template feedback……………………………………………………………………………………11

Resume template improvement opportunities…………………………………………………………….…………12

Desirable improvements to the Resume Builder tool……………………………………………………………...…24

Summary of suggested updates………………………………………………………………………………...………31

Next steps…………………………………………………………………………………………………………………32

Appendix………………………………………………………………………………………………………………..…34

3 of 43

Project

Goals & Scope

Our goal is to improve the overall user experience of the Resume Builder's new PDF template for resume reviewers (HR specialists and Hiring managers) by answering the following questions: 

  • How do resume reviewers read information on the resume builder rendering today? 
  • What information helps identify a qualified applicant? 
  • Are the sections and their content listed in a prioritized order?

3

4 of 43

Current templates

4

Current Resume Builder rendering

Improved Resume Builder rendering mockup

ATP

Web Admin

TAS/ Seeker

5 of 43

Current templates

  • Currently, the Resume Builder tool converts resumes into XML files to be sent to the Talent Acquisition System (TAS) and reviewed. 
  • The TAS+Seeker portal, Web Admin, and Agency Talent Portal websites each have a distinct template to render Resume Builder data, so the resume looks different across the products.
  • Rendering and transmission of XML for builder resume data sometimes results in missing data and/or malformed resumes when viewed by clients.
  • The templates have not been updated in a long time and have minimal structure and layout.
  • The USASUITE applications can benefit from a PDF generation of resume builders instead of XML with a consistent format of the resume across the USASUITE.

5

Current Resume builder rendering

Web Admin

TAS/ Seeker

ATP

6 of 43

Current templates

  • A single Resume Builder PDF template that is better organized and streamlined was designed for consistent use across the USASUITE. 
  • Aimed to provide a better reading experience than the current renderings
  • Modifications from the current XML templates include:
    • Different organization of content
    • Intentional use of space
    • Addition of page numbers and breaks
    • Removal of fields that no longer need to be identified (country of citizenship, veteran’s preference, and salary).
  • Used in the test as a baseline for the redesign.

6

Improved Resume Builder rendering mockup

7 of 43

Methodology & research plan

Remote moderated usability testing

Overall test plan

Findings & recommendations

  • Participants recruited from listserv/SME and screened
  • Resume review process interview followed by improved PDF template usability test
  • Conducted via screen-sharing on Teams meeting
  • Key information to determine applicant qualification
  • Current template pain points
  • First impressions of improved template
  • Resume review behaviors
  • Feedback
  • Improved understanding of resume review process
  • Desirable improvements to the PDF template
  • Insights to improve the Resume Builder tool

(Tasks are in the Appendix.)

Possible limitation:

Left out job seeker input.

7

8 of 43

9 Resume Reviewers

Participants / User Profile

Who our focus was & Why:

  • HR specialists: 7/9 | Hiring managers: 2/9
  • How often do they review resumes? Daily, Weekly, A few times in a month
  • What product do they use to view resumes? TAS, ATP
  • Do they do bulk hiring? 5/9 do
  • Which agency do they work for? OPM/Staff Acquisition, DOI-BLM, NIH, USDA, NASA, etc.

The kinds of jobs the participants work with

Secretaries

Wage grade jobs

Administrative positions

Benefits

Forestry technician

HR/HR specialist

Law enforcement

IT

Management and Program Analyst

343 series

Professional and scientific series

Data scientist

Statisticians

Grant management series

600 occupational families

Admin officer

Program management

GS-9 to GS-15 levels

System admin for USA Staffing

Natural resource positions

Positions focused on data analysis

Financial analysis

Data scientists (1560 series)

Supervisory positions (data science)

8

9 of 43

Overall findings

9

  • Resume review process
  • Resume template improvement opportunities
  • Desirable improvements to the Resume Builder tool

February 3, 2023

10 of 43

Resume review process

Check job qualifications

Review work experience and education

Confirm other information if required

Looks at what specialized experience is required to qualify for the job, and whether there is an education requirement.

Views work experience duties from recent to old for specialized experience or years of duties equivalent to a certain GS level).

Confirms education if it is required, usually alongside provided transcript.

May view job trainings for certificates, languages, publications, and references if it is required for the job, but not common.

10

11 of 43

Positive resume template feedback

of participants were able to summarize the applicant’s professional experience and thought the order of the Work Experience section's content  made sense.

of participants found it easier to read with the new text styles and layout

of participants thought the new resume builder template was cleaner and better organized, and the order of the content in the Education section made sense

100%

67%

55%

11

12 of 43

Resume template improvement opportunities

Less whitespace is preferred for a better reading experience

A well-defined spot for certificates is needed

Information related to federal jobs should stand out more

Type of date under the Education section is unclear

Affiliations section can be low priority.

2

3

4

5

1

12

13 of 43

‘Affiliations’ was the least important section to look at when reviewing resumes

Resume review process

Finding 1

Which section do you not need to see?

Which section do you need to read to determine if an applicant is qualified?

Affiliations are currently above Professional Publications and References

13

14 of 43

Suggestion 1

Move the Affiliations section to the bottom, above the Additional information section.

Resume review process

14

15 of 43

Final decision made (during the two-page resume limit updated in summer 2025)

The Affiliations section was ultimately removed from the resume. It was initially moved to the bottom to reflect its lower importance, but stakeholders decided it was no longer necessary in 2025, since users could include the same information in the Additional Information section if they chose.

15

16 of 43

Less whitespace is preferred for better reading experience.

  • A one column format was more preferable or accustomed for reading and scrolling
  • Date/hour together and in it’s own area was found helpful, but unnecessary to stay on the left hand side

Resume template improvement opportunities

Finding 2

16

17 of 43

Suggestion 2

Move date/hours to the right of position title, employers, and address.

Bring duties and rest of the information underneath in one column.

Resume template improvement opportunities

17

18 of 43

An well-defined spot for certificates is needed.

  • Certificates are hard to find under the current ‘Relevant Coursework, Licenses and Certifications’ part of Education
  • Sometimes certificates are found in the Job related training section

Resume template improvement opportunities

Finding 3

18

19 of 43

Suggestion 3

Break up the condensed ‘Relevant Coursework, Licenses and Certifications’ section under Education and have ‘Certifications’ separated (modify the resume builder tool, not the resume template).

OR

Delegate Job related training section for certificates, possibly changing the title or instructions on resume builder, and remove the certifications from Education.

Resume template improvement opportunities

19

20 of 43

Final decision made (during the two-page resume limit updated in summer 2025)

Instead of the Job related training section, the Education section was delegated for certificates by leadership. The Education section title was updated to Education, certification or licensures to clarify where certificates should be listed. Separating the single ‘Relevant Coursework, Licenses and Certifications’ form field was set as a future enhancement.

20

21 of 43

Information related to federal jobs can stand out more and be condensed

  • Federal jobs are identifiable with grade, pay scale, and series, so they should be easy to spot like dates
  • Grade and series don’t need to be fully spelled out for resume reviewers to understand

Resume template improvement opportunities

Finding 4

21

22 of 43

Suggestion 4

Condense grade, pay scale, and series to format [grade acronym]-[series number]-[payscale number], and bring in front of job title. This formatting is used on applications.

Resume template improvement opportunities

22

23 of 43

Final decision made (during the two-page resume limit updated in summer 2025)

The Hiring Experience team decided it was not necessary to ask about the pay scale in the resume builder. Since listing only the acronyms for series and grade could be confusing, they were listed with clear headers in front and beneath the job title. Only the series number and grade number were displayed.

23

24 of 43

Dates under Education section are confusing.

  • There is no clear indicator of what type of date is next to each Education entry
  • Some wonder if it is the conferral date or end date, and why it doesn’t mention if it’s completed or ongoing

Resume template improvement opportunities

Finding 5

24

25 of 43

Suggestion 5

When a date is provided, add a header about the type of date (completion date).

Adjust alignment as the Work Experience section

Resume template improvement opportunities

25

26 of 43

Other ideas to save space

26

Do not display full address of employer. Limit to city and state.

The heading for duties is not necessary as a list of work experience duties is easy to tell

1

2

Resume template improvement opportunities

27 of 43

Desirable improvements to the

Resume Builder tool

Improve guidance on information that should be in the duties of a work experience, as well as suggested formats

Add explanation for optional fields and why they are being asked

New optional fields that are nice to have: introduction or short skills summary, and optional day field for work experience dates

6

7

8

27

28 of 43

Improve guidance for job seekers on writing duties

  • Resume reviewers constantly see redundant information in work experience duties
  • Need better guidance to receive helpful information in duties to qualify the applicant (eg. explain what specialized experience is)
  • Format of text is up to the job seeker

Desirable improvement to Resume Builder

Finding 6

28

29 of 43

Suggestion 6

Add suggestion to review the specialized experience of the job announcement and provide details that support it for the Duties.

Explain what specialized experience is.

Mention suggested format to write out duties (use of action verbs, brevity, simplicity, etc.)

Desirable improvement to Resume Builder

29

30 of 43

Explain the importance of optional fields

  • Salary and military rank information helps resume reviewers to determine the GS level of a non federal job and qualify the applicant
  • Need better guidance urging applicants to fill in the optional fields if they can

Desirable improvement to Resume Builder

Finding 7

30

31 of 43

Suggestion 7

Explain who views the optional information, and why it will be helpful to include it.

For salary, may need to tell users about why they might not want to provide salary as well.

Desirable improvement to Resume Builder

NOTE TO SELF: Add screenshot of where military rank input will look like in resume builder

31

32 of 43

Nice to haves: summary section and day field for work dates

  • Some resume reviewers will read a short summary of skills/interest statement if provided as supporting information to duties.
  • If the day was included in the dates of experience, the timeframe of the work experience can be calculated more accurately

Desirable improvement to Resume Builder

Finding 8

32

33 of 43

Suggestion 8

Provide a Summary section in the Resume Builder. It will populate at the top of the resume between contact information and work experience.

Add optional day field to work experience dates. Will need policy approval for this.

Desirable improvement to Resume Builder

33

34 of 43

Summary of

suggested updates

34

Provide guidance on duties

Explain the importance of optional fields

Consider adding a summary and work experience day field

6

7

8

Remove left-side whitespace

Choose one area to list certificates

Improve indication of federal jobs

Label the date for education

2

3

4

5

De-prioritize Affiliations section

1

Changes to the document template

Suggested future changes to the Resume Builder

35 of 43

Next steps

35

New suggested Resume Builder PDF template (link in Appendix)

  • Some suggested improvements to the Resume Builder tool will require policy change (any addition/removal of fields)
  • Usability test the new Resume Builder tool currently being developed by Sam with the latest design system on a separate page (instead of modals) with job applicants
  • Test mockups of suggested improvements to Resume Builder tool along with on hold enhancements with users (during test of newly developed MVP)

36 of 43

36

Thank you for your time.

Any questions?

37 of 43

Appendix

37

  • Participants profiles table
  • Table of issues
  • Rank of severity
  • Improved template rating
  • Important Work Experience content
  • Important Education content
  • Templates/Mockups

ID.

Position

Participants’ information

PA

PB

PC

PD

PE

PF

PG

PH

PI

HR Specialist

Hiring Manager

HR Specialist

HR Specialist

Hiring Manager

HR Specialist

HR Specialist

HR Specialist

Hiring Manager

  • OPM (Uses TAS)
  • Reviews resumes daily
  • Does bulk hiring
  • USDA (Uses TAS)
  • Reviews resumes a few times a month
  • Does bulk hiring
  • OPM (Uses TAS)
  • Reviews resumes daily
  • Does not do bulk hiring
  • NIH
  • Reviews resumes weekly
  • Does not do bulk hiring
  • USDA (Uses TAS)
  • Reviews resumes weekly
  • Does bulk hiring
  • HHS - NIH
  • Reviews resumes a few times a month
  • Does not do bulk hiring
  • NASA
  • Reviews resumes daily
  • Does bulk hiring
  • DOI - BLM (Uses TAS)
  • Reviews resumes weekly
  • Does not do bulk hiring
  • OPM
  • Reviews resumes a few times a month
  • Does bulk hiring

38 of 43

Appendix

38

  • Participants profiles table
  • List of issues
  • Rank of severity
  • Improved template rating
  • Important Work Experience content
  • Important Education content
  • Templates/Mockups

39 of 43

Appendix

39

  • Participants profiles table
  • List of issues
  • Rank of severity
  • Improved template rating
  • Important Work Experience content
  • Important Education content
  • Templates/Mockups

Sort

1

2

3

4

3+4

Resume review process

Resume layout

Resume Builder

Current template

Severity 0

3

7

N/A

N/A

N/A

0

N/A

6

4

2

N/A

2

N/A

3

N/A

1

N/A

1

1

1

2

1

N/A

1

Rating

0 - not usability issue

1 - cosmetic issue

2 - minor problem

3 - major problem

4 - usability catastrophe

40 of 43

4.3

40

How easy was it to scan through the resume?

Overall score

1 - difficult

5 - easy

Average

score

“Would like more space for details on Duties”

“The education date is not specific”

“Getting rid of the white space would make it better”

41 of 43

Appendix

41

  • Participants profiles table
  • List of issues
  • Rank of severity
  • Improved template rating
  • Important Work Experience content
  • Important Education content
  • Templates/Mockups

What are the most important pieces of information under Work Experience?

42 of 43

Appendix

42

  • Participants profiles table
  • List of issues
  • Rank of severity
  • Improved template rating
  • Important Work Experience content
  • Important Education content
  • Templates/Mockups

What are the most important pieces of information under Education?

43 of 43

Appendix

43

  • Participants profiles table
  • List of issues
  • Rank of severity
  • Improved template rating
  • Important Work Experience content
  • Important Education content
  • Templates/Mockups