ai newsSo., 1. Nov.
EilmeldungLLM API Slows to 30s, Your Server Holds 600 Requests: Little's Law and a Load Shedder

Fail CI when a pull request adds a retired OpenAI or Anthropic model

A retired AI model doesn't fail your tests, because your tests mock the LLM. It fails in production, the day after the shutdown date. So check model IDs where you check everything else: on the pull request. The workflow .github/workflows/models.yml : name : AI models on : pull_request jobs : models

dev.toSonntag 16:00 · 01.11.1 Min. Lesezeit
Bild: dev.to

A retired AI model doesn't fail your tests, because your tests mock the LLM. It fails in production, the day after the shutdown date.

So check model IDs where you check everything else: on the pull request.

name: AI models on: pull_request jobs: models: runs-on: ubuntu-latest permissions: contents: read pull-requests: write # for the PR comment steps: - uses: actions/checkout@v4 - uses: versyka/versyka-action@v1 Enter fullscreen mode Exit fullscreen mode That's it. No account, no API key.

The comment is updated in place on each push, so the PR doesn't fill up with bot messages.

- uses: versyka/versyka-action@v1 with: fail-on: soon # none | retired (default) | soon | behind days: 60 # how far ahead counts as "soon" (default 90) comment: true # comment on the PR (default true) path: services/api # folder to check, for monorepos (default.) Enter fullscreen mode Exit fullscreen mode fail-on: soon is useful the month before a big shutdown date: it turns the heads-up into a blocker.

The step exposes retired, soon and behind as outputs, so you can branch on them:

- id: models uses: versyka/versyka-action@v1 with: fail-on: none - if: steps.models.outputs.soon!= '0' run: echo "Models retiring soon: ${{ steps.models.outputs.soon }}" Enter fullscreen mode Exit fullscreen mode Where the dates come from The same retirement data behind versyka.com/model-retirements, with dates from OpenAI, Anthropic, Google, Mistral, Cohere, AWS Bedrock, Azure, Groq and Together AI.

The action is on the GitHub Marketplace.

Quelle: dev.to (dev.to). Original öffnen