AI Prompt Tester

Application Deadline: 25 April 2025

Department: Product

Location: Philippines

Description

About Magic


Magic is a leading modern outsourcing platform that connects SMBs to high-quality remote workers, from SDRs to virtual assistants and more. With roots in Silicon Valley, and backing from top venture capitalists, our workers are supercharged with a combination of the latest AI technology and training.

Background


Our company came out of Y Combinator in 2015. Since then we've grown to 1000+ remote workers, with strong venture-backing (including Sequoia Capital) and over $30M in funding to date. We are fully remote across Asia and US time zones.

• Check out Magic's Business Profile


• Know more about our Team via Magic's Careers Page

As an AI Prompt Tester, you'll maximize the effectiveness of our AI tools by developing, testing, and optimizing prompts across various business verticals. As we integrate AI solutions into our products, the AI Prompt Tester will be instrumental in ensuring these tools deliver accurate, relevant, and valuable outputs that enhance user experience and drive business outcomes.

The impact you’ll make:

Prompt Development & Optimization

• Write clear, effective prompts tailored to different business verticals


• Continuously refine prompts based on real-world assistant results and feedback


• Conduct experimental testing of prompt variations to identify optimal formulations


• Document successful prompt patterns and best practices

Cross-functional Collaboration

• Work side-by-side with product and engineering teams.


• Share your insights and improvements through regular updates and documentation.


• Help train internal teams on how to use AI prompts effectively.

Performance Analysis

• Utilize the prompt dashboard to automate and streamline testing


• Track and analyze prompt performance metrics across different scenarios


• Identify trends, issues, and opportunities for improvement


• Maintain comprehensive records of prompt versions, test results, and iterations

AI Knowledge & Innovation

• Stay current with emerging AI developments and prompt engineering techniques


• Participate in relevant workshops, discussions, and training sessions


• Research and recommend ways to incorporate new AI technologies


• Contribute to the company's AI strategy and roadmap

Skills, Knowledge and Expertise

• Demonstrated proficiency with spreadsheet applications for data tracking and analysis


• Basic understanding of AI platforms (ChatGPT, Gemini, Copilot, Perplexity etc.)


• Familiarity with fundamental prompt engineering concepts


• Strong analytical and critical thinking skills


• Excellent written and verbal communication abilities

Your superpowers are...

• Attention to detail when crafting and refining prompts


• Pattern recognition for identifying what works across different contexts


• Creative problem-solving to overcome AI limitations


• Clear and concise writing skills


• Patience and persistence when troubleshooting


• Curiosity and eagerness to learn about emerging technologies


• Ability to translate complex technical concepts into simple explanations

You should apply if...

• You're fascinated by the potential of AI and enjoy exploring its capabilities


• You find satisfaction in iterative improvement and optimization


• You thrive in collaborative environments with diverse stakeholders


• You approach challenges with both creativity and analytical rigor


• You're comfortable with ambiguity and evolving requirements


• You're motivated to help shape the future of AI-powered products

Why Magic?