AI Evaluation Specialist for Small Business Scenarios

About the role

We are looking for a freelance specialist to evaluate AI chatbot responses for realistic small-business scenarios. You will create prompts, interact with multiple chatbots, and assess the quality of their answers to help improve AI tools used by entrepreneurs.

Key responsibilities

• Design realistic business-related prompts based on defined user goals.
• Conduct short conversations (up to five turns) with up to five different AI chatbots.
• Rate responses on clarity, usefulness and accuracy.
• Provide structured feedback, comparative evaluations and submit conversation transcripts.
• Assist with creating visual marketing content and support day-to-day operational queries.
• Perform market research, data analysis and financial planning support using spreadsheets and other files.

Required profile

• Current small-business owner or deep familiarity with small-business operations.
• Strong analytical and critical-thinking abilities.
• Ability to follow detailed evaluation guidelines.
• Comfortable interacting with AI tools and reviewing generated content.

Required skills

What we offer

• Fully remote, flexible schedule.
• Opportunity to work on cutting-edge AI applications in the business domain.
• Project-based contract lasting approximately 10 weeks.