Skip to content

v2.8.0

Choose a tag to compare

@meirk-brd meirk-brd released this 07 Jan 08:20
· 92 commits to main since this release

Release Notes - v2.8.0 🚀

Token Optimization

This release focuses on reducing token consumption for AI agents, making interactions more efficient and cost-effective.

Changes

Search Engine Improvements

  • Switched web search results to parsed_light format for leaner responses
  • Cleaned up search payloads to return only essential fields (link, title, description)
  • Removed unnecessary fields like images, pagination, related, and ai_overview from search results

Markdown Minification

  • Added markdown stripping for scrape_as_markdown responses using remark and strip-markdown
  • Preserves essential elements (links, code blocks) while removing formatting overhead
  • Achieves 30-60% reduction in tool response tokens

Data Sanitization

  • Removed null values from dataset API responses to reduce payload size

New Dependencies

  • remark: ^15.0.1
  • strip-markdown: ^6.0.0

MCP Evaluations Framework

We've added a comprehensive evaluations suite powered by mcpjam to validate agent behavior before production.

Structure

mcp-evals/
├── server-configs/           # Server connection configs per tool group
├── tool-groups.json/         # Test cases per tool group
└── llms.json                 # LLM provider API keys

Coverage

Eval suites for all 8 Tool Groups:

  • ecommerce - Amazon, Walmart, Best Buy product searches
  • social - TikTok, Instagram, Twitter content
  • business - LinkedIn profiles, Crunchbase, Google Maps
  • research - GitHub repos, Reuters news, academic sources
  • finance - Stock data, market trends
  • app_stores - iOS App Store, Google Play
  • browser - Scraping Browser automation
  • advanced_scraping - Batch operations, custom scraping

Quick Start

# Install mcpjam
npm install -g @mcpjam/cli

# Run e-commerce evals
mcpjam evals run \
  -t mcp-evals/tool-groups.json/tool-groups.ecommerce.json \
  -e mcp-evals/server-configs/server-config.ecommerce.json \
  -l mcp-evals/llms.json

Performance Impact

Combined with Tool Groups and Custom Tools from previous releases:

Configuration Total Tokens Cost Reduction
Full Suite (No Optimization) 37,500 -
+ Tool Groups 28,500 24%
+ Custom Tools 24,750 34%
+ Token Optimization (v2.8.0) 14,500 61%

Resources