A remote QA role at Filevine.
How Sydicom helps: we read this listing’s requirements and tune your CV and cover letter to the keywords its ATS (Lever) is scanning for, wherever you are, then help you apply.
Original listing text, shown exactly as published by the company.
•
Define and own the test strategy, process, and QA playbook for the product
•
Move QA upstream by partnering with product and engineering early, so test plans are ready before features ship
•
Evaluate AI output quality across dimensions like accuracy, citation reliability, and appropriately scoped reasoning
•
Design and maintain evaluation sets that account for non-deterministic output and catch regressions over time
•
Test how AI-generated edits apply to documents, including accuracy and formatting fidelity across document structures
•
Build automated guardrails integrated into CI/CD that cover critical flows
•
Write structured, reproducible bug reports
•
Partner with legal domain experts to understand how different customer types use the product, and translate that into test coverage
•
Approach QA with a product and design mindset. If something works but could be better, we want to hear it
•
Compare behavior across product surfaces and document discrepancies
•
2+ years of QA experience, including ownership of test strategy for a product or major feature area
•
Track record of building QA process and automation from scratch in a fast-moving environment
•
Comfort operating in high ambiguity, where features ship quickly and you figure out how to test them fast
•
Strong analytical and problem-solving skills, with attention to both functional correctness and AI output quality
•
Ability to reason about non-deterministic systems and define what "correct" means when there's no single right answer
•
Excellent written communication, with the ability to write clear, concise, actionable bug reports backed by evidence
•
Experience with bug tracking tools and test management workflows
•
Experience testing AI or LLM-based products, especially for output accuracy and eval design
•
CI/CD experience setting up pipelines and release gates for automated tests
•
A design or UX sensibility, with an eye for where product workflows could be smoother
•
Prior experience in legal technology or comfort reading legal contracts…
Filevine
QA
95 open roles on Sydicom
Filevine is a legal technology company that provides cloud-based case and practice management software. Their platform helps law firms and legal departments streamline workflows, manage documents, and enhance communication. It is known for modernizing legal operations through automation and an intuitive user experience.
Generated by Sydicom AI
