Top Tech Jobs & Startup Jobs

Contribute financial expertise to train and evaluate AI language models: design finance tasks, produce reference solutions, evaluate AI outputs with rubrics, collaborate with SMEs, and identify knowledge gaps to improve AI reasoning in finance. Independent contractor role requiring at least 10 hours/week.

Contractor engineering SME to review and create technical engineering content for AI training: analyze documentation, develop examples and datasets, evaluate AI outputs for technical accuracy, and collaborate with teams to improve model performance and processes.

Perform structured evaluations of AI assistants using MCP and plugins: design realistic prompts, execute multi-step personal workflows (screen-recorded), assess outputs for usefulness and safety, identify failures, and write detailed reports and rubrics. Remote, US-based contractor role requiring 20+ hours/week and rapid task turnaround.

Design and evaluate performance engineering tasks for AI training/evaluation. Optimize runtime, compilers, memory, CPU/GPU and concurrency. Produce documented solutions, evaluate AI-generated code, and build evaluation frameworks and scoring rubrics while collaborating with researchers and SMEs.

Design real-world ML and NLP tasks, build reference solutions and evaluation frameworks in Python, assess LLM outputs for correctness and reasoning, identify failure modes, create scoring rubrics, and collaborate with experts to improve model capabilities. Part-time, remote contractor (~20 hours/week).

Create clear, structured rater guidelines, evaluation rubrics, and reviewer instructions for human evaluators across domains. Review and revise documentation to remove ambiguity, design scoring frameworks, handle edge cases, and collaborate with researchers and SMEs to ensure consistent, high-quality AI evaluations.

Contractor role to create original, high-quality financial documents (reports, analyses, models) with rich visuals (tables, charts, graphs) to train AI. Ensure accuracy, anonymize sensitive data, contribute long-form documents (10–100 pages), and clarify submissions as needed.

Design and run red-team evaluations to find failure modes and edge cases in frontier LLMs. Create reproducible, multi-step benchmark tasks, document technical findings, and collaborate with researchers to refine grading and improve model robustness. Commit ~35 hours/week as a remote independent contractor.

Build and maintain PySpark-based ETL pipelines and large-scale data workflows for finance. Write and optimize complex SQL, ensure data quality, collaborate with finance and engineering stakeholders, and document data models and processes to improve reliability and performance.

Design and author research-oriented, multi-step benchmark tasks for frontier AI models; create reference solutions and evaluation standards using Python and notebooks; review AI outputs to identify methodological and analytical flaws; collaborate with AI researchers to refine evaluation methodologies.