Top-Selling Points

Rate of Foreigners

Less Than

Frequency of English Usage

Less Than

Top-Selling Points

Rate of Foreigners
Less Than

Frequency of English Usage
Less Than

Related Skills

Management/System project Experience

Others

Language Requirements

Required

Preferred

Language Requirements

Required

Japanese: Daily Conversational

English: Business

Preferred

No Data

Job Description

The company was established in April 2023 as a group company of a listed enterprise, with the goal of dramatically enhancing the potential of the workforce through AI technology. It promotes domestic and international research and development by leveraging cutting-edge AI.

The company's goal is not merely to provide AI chatbots. It is to build the "Corporate Brain"—a next-generation core system where all of a company's SaaS are integrated and AI executes tasks autonomously. Centered around its AI platform, the company is implementing a world where, as long as a database exists, no separate applications are required; the AI performs the work and returns only the results.

The company aims to create new value and contribute to the progress of society as a whole through the transformative power of AI. Together, let us lead AI-driven innovation and create a future where technology empowers people to achieve more.

【Recruitment Background】
AI agent output quality directly impacts corporate operations. "It mostly works" is not an acceptable standard.

In a world where the company's AI platform autonomously executes tasks such as internal approvals, resource allocation, and lead generation as a "Corporate Brain," an error in AI output could lead to the approval of unauthorized requests, incorrect staffing, or inappropriate customer outreach. For the "Corporate Brain" to be trusted, a system that scientifically evaluates and guarantees the accuracy, safety, and consistency of generated responses is indispensable.

To scientifically guarantee the quality of AI agents used in production environments by over 200 client companies, the company is seeking an AI QA Specialist to build a quality assurance framework based on automated evaluation pipelines, red teaming, and statistical experimental design.

【Your Role】
As an AI QA Specialist, you will lead the design, construction, and operation of the quality evaluation foundation for AI agents.
・Take ownership of tasks ranging from the selection and design of evaluation metrics to the integration of automated evaluation pipelines into CI/CD.
・Detect safety risks prior to release through the planning and execution of red teaming.
・Quantitatively verify the effectiveness of quality improvements via A/B test analysis based on statistical experimental design.
・Research evaluation signals and provide feedback to the development teams to create a compounding loop for model improvement.
・Ensure the quality of products used in production by approximately 200 companies through an approach that "applies science" to quality assurance.

【Responsibilities】
Design and Construction of Evaluation Foundations
・Design, construction, and maintenance of evaluation sets (synthetic data + actual logs).
・Selection and design of evaluation metrics (win rate, task success, factuality, harm detection).
・Construction of automated evaluation pipelines and integration into CI/CD.
・Design of agent harnesses (supporting multi-turn interactions, tool usage, and long contexts).

Safety and Quality Verification
・Planning and execution of red teaming (adversarial testing).
・Construction of verification frameworks for safety and policy compliance.
・Design and execution of regression tests for prompts and tools.
・Analysis and improvement of issues related to hallucinations, bias, and output quality.

Statistical Analysis and Reporting
・Design and analysis of statistical experimental plans (A/B testing, significance testing).
・Preparation of quality reports and proposals for improvement.
・Visualization of regression detection and quality trends.
・Feedback of evaluation signals to the research and development teams.

【Team Structure】
The development organization consists of approximately 120 members.
The Product Architect will collaborate closely with the following teams and stakeholders:

・Closely collaborating roles:
Agentic Product Engineer — Development of agent functions
Research Engineer — Research and development / Model improvement
Agent_Harness Engineer / Software Engineer (AI Platform) — AI execution foundation development
Product Manager — Product design and definition of quality requirements

Required Skills and Experiences

【Required】 Bachelor's degree in computer science, software engineering, artificial intelligence, machine learning, mathematics, physics, or a related field, or equivalent professional experience 3+ years of professional experience as a software engineer or QA engineer Knowledge of evaluation methods for LLMs and generative AI (prompt evaluation, quantitative measurement of output quality, hallucination detection, etc.) Basic knowledge of statistics and experimental design Experience building evaluation pipelines in Python Experience integrating tests into CI/CD pipelines Experience designing prompt and tool regression tests ・Language proficiency: One of the following is required Japanese: Fluent (able to discuss product development without misunderstandings) or English: Business level 【Preferred】 Experience designing evaluation benchmarks for NLP and ML Knowledge of AI safety and Responsible AI Experience with red teaming and penetration testing Experience evaluating multi-agent workflows, tool usage, and long-context scenarios Experience with large-scale data processing (e.g., Spark, BigQuery) Ability to read research papers and reproduce their results Ability to communicate technically in English

After sign up, you can browse all information.

If you already have a GitTap Account, please login.

Working Condition

Benefits
【For Full-time Employees】
Housing Allowance: Up to 30,000 JPY/month (applicable to designated areas/stations).
Employee Stock Ownership Plan (ESOP): Opportunity to participate in the company’s growth through stock ownership.
Health & Wellness: Annual periodic health checkups provided.

【For Contract Employees】
Health & Wellness: Annual periodic health checkups provided.

【Common Benefits (Full-time & Contract)】
Learning & Development Support:
・Book Purchase Subsidy: Up to 30,000 JPY per half-year for technical books and learning materials.
・Language & Certification Support: Coverage for Japanese/English learning programs and professional certifications (when required for business).

Work-Life Balance & Wellbeing:
・Monthly Refresh Allowance: Up to 5,000 JPY/month for wellness and entertainment (e.g., gym, yoga, massage, cinema, or theme park tickets).
・Refresh Leave: 2 days of special annual leave granted to employees with over 3 years of continuous service.

Social & Team Building:
・Club Activity Allowance: Up to 5,000 JPY/month to support interest-based internal communities.
・Shuffle Lunch/Dinner: Quarterly subsidies (up to 1,000 JPY for lunch / 5,000 JPY for dinner) to encourage cross-team communication.

Learning & Development (Tech-Specific Support)
The company is committed to providing a cutting-edge environment for creators and engineers.
・AI Tool Support:
Full company coverage for essential AI tools, including Proprietary SaaS services, Cursor, ChatGPT (Plus/Enterprise), Claude, and other industry-standard AI platforms.
・Development Tool Subsidy:
If a preferred development tool or software is paid, the company will cover the cost (up to 30,000 JPY/year).
・Comprehensive Insurance:
Fully equipped with Social Insurance (Health, Pension, Unemployment, and Workers' Compensation).
・Commutation Allowance:
Full coverage of all transportation expenses.

RECRUITMENT PROCESS

Document screening → Interview (2-3 times) → Offer
*Reference checks will be required before the final interview.

Business (description what they do)

Recruiting business specializing in job change support for foreign IT personnel

Available Jobs in (G Talent)

Recommended Jobs

G Talent

Product Manager (New Business Planning)

6M - ***M JPY | Tokyo

Others

Goofy inc.

Project Manager (Package and Middleware Systems)

4M - ***M JPY | Tokyo

Sales Force Others Project Management

G Talent

【ProdDev】Design Manager (SaaS Business)

7M - ***M JPY | Tokyo

Others

G Talent

Full-stack Specialist

9M - ***M JPY | Tokyo

Android AWS Docker

Top-Selling Points

Rate of Foreigners

Less Than

Frequency of English Usage

Less Than

Top-Selling Points

Rate of Foreigners
Less Than

Frequency of English Usage
Less Than

Related Skills

Management/System project Experience

Others

Language Requirements

Required

Preferred

Language Requirements

Required

Japanese: Daily Conversational

English: Business

Preferred

No Data

Job Description

The company was established in April 2023 as a group company of a listed enterprise, with the goal of dramatically enhancing the potential of the workforce through AI technology. It promotes domestic and international research and development by leveraging cutting-edge AI.

The company's goal is not merely to provide AI chatbots. It is to build the "Corporate Brain"—a next-generation core system where all of a company's SaaS are integrated and AI executes tasks autonomously. Centered around its AI platform, the company is implementing a world where, as long as a database exists, no separate applications are required; the AI performs the work and returns only the results.

The company aims to create new value and contribute to the progress of society as a whole through the transformative power of AI. Together, let us lead AI-driven innovation and create a future where technology empowers people to achieve more.

【Recruitment Background】
AI agent output quality directly impacts corporate operations. "It mostly works" is not an acceptable standard.

In a world where the company's AI platform autonomously executes tasks such as internal approvals, resource allocation, and lead generation as a "Corporate Brain," an error in AI output could lead to the approval of unauthorized requests, incorrect staffing, or inappropriate customer outreach. For the "Corporate Brain" to be trusted, a system that scientifically evaluates and guarantees the accuracy, safety, and consistency of generated responses is indispensable.

To scientifically guarantee the quality of AI agents used in production environments by over 200 client companies, the company is seeking an AI QA Specialist to build a quality assurance framework based on automated evaluation pipelines, red teaming, and statistical experimental design.

【Your Role】
As an AI QA Specialist, you will lead the design, construction, and operation of the quality evaluation foundation for AI agents.
・Take ownership of tasks ranging from the selection and design of evaluation metrics to the integration of automated evaluation pipelines into CI/CD.
・Detect safety risks prior to release through the planning and execution of red teaming.
・Quantitatively verify the effectiveness of quality improvements via A/B test analysis based on statistical experimental design.
・Research evaluation signals and provide feedback to the development teams to create a compounding loop for model improvement.
・Ensure the quality of products used in production by approximately 200 companies through an approach that "applies science" to quality assurance.

【Responsibilities】
Design and Construction of Evaluation Foundations
・Design, construction, and maintenance of evaluation sets (synthetic data + actual logs).
・Selection and design of evaluation metrics (win rate, task success, factuality, harm detection).
・Construction of automated evaluation pipelines and integration into CI/CD.
・Design of agent harnesses (supporting multi-turn interactions, tool usage, and long contexts).

Safety and Quality Verification
・Planning and execution of red teaming (adversarial testing).
・Construction of verification frameworks for safety and policy compliance.
・Design and execution of regression tests for prompts and tools.
・Analysis and improvement of issues related to hallucinations, bias, and output quality.

Statistical Analysis and Reporting
・Design and analysis of statistical experimental plans (A/B testing, significance testing).
・Preparation of quality reports and proposals for improvement.
・Visualization of regression detection and quality trends.
・Feedback of evaluation signals to the research and development teams.

【Team Structure】
The development organization consists of approximately 120 members.
The Product Architect will collaborate closely with the following teams and stakeholders:

・Closely collaborating roles:
Agentic Product Engineer — Development of agent functions
Research Engineer — Research and development / Model improvement
Agent_Harness Engineer / Software Engineer (AI Platform) — AI execution foundation development
Product Manager — Product design and definition of quality requirements

Required Skills and Experiences

After sign up, you can browse all information.

If you already have a GitTap Account, please login.

Working Condition

Benefits
【For Full-time Employees】
Housing Allowance: Up to 30,000 JPY/month (applicable to designated areas/stations).
Employee Stock Ownership Plan (ESOP): Opportunity to participate in the company’s growth through stock ownership.
Health & Wellness: Annual periodic health checkups provided.

【For Contract Employees】
Health & Wellness: Annual periodic health checkups provided.

【Common Benefits (Full-time & Contract)】
Learning & Development Support:
・Book Purchase Subsidy: Up to 30,000 JPY per half-year for technical books and learning materials.
・Language & Certification Support: Coverage for Japanese/English learning programs and professional certifications (when required for business).

Work-Life Balance & Wellbeing:
・Monthly Refresh Allowance: Up to 5,000 JPY/month for wellness and entertainment (e.g., gym, yoga, massage, cinema, or theme park tickets).
・Refresh Leave: 2 days of special annual leave granted to employees with over 3 years of continuous service.

Social & Team Building:
・Club Activity Allowance: Up to 5,000 JPY/month to support interest-based internal communities.
・Shuffle Lunch/Dinner: Quarterly subsidies (up to 1,000 JPY for lunch / 5,000 JPY for dinner) to encourage cross-team communication.

Learning & Development (Tech-Specific Support)
The company is committed to providing a cutting-edge environment for creators and engineers.
・AI Tool Support:
Full company coverage for essential AI tools, including Proprietary SaaS services, Cursor, ChatGPT (Plus/Enterprise), Claude, and other industry-standard AI platforms.
・Development Tool Subsidy:
If a preferred development tool or software is paid, the company will cover the cost (up to 30,000 JPY/year).
・Comprehensive Insurance:
Fully equipped with Social Insurance (Health, Pension, Unemployment, and Workers' Compensation).
・Commutation Allowance:
Full coverage of all transportation expenses.

RECRUITMENT PROCESS

Document screening → Interview (2-3 times) → Offer
*Reference checks will be required before the final interview.

Business (description what they do)

Recruiting business specializing in job change support for foreign IT personnel

Available Jobs in (G Talent)

Recommended Jobs

bryza co.,ltd.

[Open position / If you are having trouble, click here! Software Design

3M - ***M JPY | Hokkaido(+47)

Others

G Talent

Product Manager (Ad Tech, Ad Fraud)

5M - ***M JPY | Tokyo

Others

G Talent

Full-stack Specialist

9M - ***M JPY | Tokyo

Android AWS Docker

G Talent

Technical Project Manager (LLM New Business)

7M - ***M JPY | Tokyo

Big Data Deep Learning Machine Learning

AI QA Specialist (LLM Evaluation)

AI QA Specialist (LLM Evaluation)