Senior Accessibility Specialist/DHS Trusted Tester

, REMOTE

Job ID: 5448

CALIBRE Systems, Inc., an employee-owned mission focused solutions and digital transformation company, is looking for a highly qualified Accessibility Specialist with current DHS Trusted Tester Certification to support the testing and validation of a public-facing Conversational AI Intelligence Layer deployed on a website. This work is remote. Applicant must be able to achieve a Public Trust clearance.

The selected candidate will be responsible for evaluating and validating the complete user experience, ensuring accessibility compliance, functional accuracy, usability, and adherence to legal, privacy, and content governance requirements. This role requires expertise in accessibility testing, software quality assurance, AI-enabled applications, and Section 508 compliance.

The Accessibility Specialist will work closely with business analysts, developers, solution architects, and quality assurance personnel to ensure the application delivers accurate, accessible, secure, and trustworthy information to the public.

 

Responsibilities include, but are not limited to:

·       Accessibility Testing

·       Perform Section 508/WCAG accessibility testing using DHS Trusted Tester processes.

·       Conduct manual and automated accessibility assessments.

·       Validate assistive technology compatibility and identify remediation needs.

·       AI & Conversational Validation

·       Test AI responses, semantic search, citations, and content summaries.

·       Validate user intent recognition and conversational accuracy.

·       Ensure responses remain grounded in approved source content.

·       Functional Testing

·       Develop and execute test plans and test cases.

·       Perform functional, regression, system, and end-to-end testing.

·       Validate cross-browser, cross-device, and user feedback functionality.

·       Responsible AI & Governance Testing

·       Validate content safety controls, business rules, and compliance requirements.

·       Verify privacy controls, PII filtering, and content moderation.

·       Ensure AI outputs comply with governance and approved-content requirements.

·       Reporting & Documentation

·       Document defects, test results, and compliance findings.

·       Produce testing reports and recommendations.

 

• Support reviews and continuous improvement efforts

Required Skills

·       Must have Bachelor of Science degree in Computer Science, Information Systems, Engineering, Business, or other relevant discipline.

·       Minimum 3 years of experience performing functional testing of software applications using both manual and automated testing tools.

·       Minimum 2 years of experience serving as a Programmer/Analyst, Systems Analyst, Software Engineer, or comparable technical role.

·       Experience testing web-based applications in a production environment.

·       Experience performing accessibility testing of websites, web applications, or digital services.

 

required Experience

·       Must have DHS Trusted Tester Certification

·       Excellent written and verbal communication skills

·       Section 508 Compliance Testing

·       WCAG 2.1/2.2 Accessibility Testing

·       Assistive Technology Testing (JAWS, NVDA, VoiceOver, etc.)

·       HTML, CSS, JavaScript, and ARIA Fundamentals

·       Manual Accessibility Evaluation Techniques

·       Functional Software Testing

·       Automated Testing Tools (Axe, Accessibility Insights, Selenium, Playwright, WAVE, Lighthouse, or equivalent)

·       Test Case Development and Execution

·       Accessibility Defect Analysis and Reporting

 

Desired Skills: (optional)

·       Generative AI Testing and Evaluation

·       Large Language Model (LLM) Validation

·       Semantic Search Testing

·       Prompt Engineering and AI Response Evaluation

·       Azure AI Foundry Experience

·       Azure AI Search Experience

·       Azure Content Safety Experience

·       Azure Monitor and Application Insights Experience

·       REST API Testing (Postman or similar tools)

·       Agile/Scrum Development Methodologies

CALIBRE is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, disability, veteran status, age, marital status, pregnancy, genetic information, or other legally protected status. For our EEO Policy statement, please click here. If you would like more information on your EEO rights under the law, please click here.

If you would like to contact us regarding the accessibility of our website of need assistance completing the application process, please contact accommodations@calibresys.com or call 703.797.8732. Please note this contact information is for accommodations only.