Best Practices

​

Rate Limits

• Handle 429 responses: Implement retry with exponential backoff
• Monitor usage: Check your dashboard for rate limit status
• Retry example:

async function request(url) {
  for (let i = 0; i < 3; i++) {
    try {
      return await fetch(url);
    } catch (e) {
      if (e.status !== 429) throw e;
      await new Promise((r) => setTimeout(r, 1000 * 2 ** i));
    }
  }
}

​

Security

• Never hardcode keys — use process.env.SCRAPEST_API_KEY
• Add to .gitignore — never commit keys
• Use HTTPS — always secure connections

​

Quick Checklist

• API key in environment variables
• Retry logic implemented
• HTTPS for all endpoints
• Error handling in place