v0.5.0-beta.10: Model capabilities, test harness, and packaging fixes by sbaker · Pull Request #10 · Prompd/prompd-cli

sbaker · 2026-03-31T01:43:32Z

Summary

Model Capabilities system — new ModelCapabilities interface with per-model flags (useMaxCompletionTokens, noTemperature, noSystemMessage, supportsThinking, supportsVision, supportsTools, etc.)
Updated model registry — added gpt-4.1/mini/nano, o1, o3, o3-mini, o4-mini, Claude 4 Sonnet/Opus, Gemini 2.5 Pro/Flash with full capability annotations
Provider layer uses capabilities — OpenAICompatibleProvider sends max_completion_tokens vs max_tokens, skips temperature/system messages based on model flags, with prefix-matching for date-suffixed model IDs
TestHarness interface — extensible contract for test frameworks (@prompd/test) with plugin registration via registerTestHarness()
Frontmatter hints — metadata hints for IDE integration
Include path resolution fix — correct relative path handling for {% include %} directives
Binary asset pre-extraction — xlsx, docx, pdf extracted during packaging stage
prompd.json dependency manifest — standardized manifest format

Test plan

gpt-4.1-nano uses max_completion_tokens instead of max_tokens
o1/o3 models skip temperature parameter and system messages
Prefix matching works for date-suffixed model IDs (e.g., gpt-4.1-nano-2025-04-14)
TestHarness registration and execution via @prompd/test
Include path resolution with nested directory structures
Package creation with binary asset extraction

🤖 Generated with Claude Code

Binary assets referenced in .prmd context fields are now converted to text during packaging instead of being included as raw binaries. This prevents registry security validation rejections. - xlsx/xls → CSV text (.csv.txt) - docx → plain text (.txt) - pdf → plain text (.txt) Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

…ate stage Resolve relative {% include %} paths to absolute when merging parent content into child prompts, preventing broken references when parent/child are in different directories. Apply default values with type coercion for parameters inherited from parent prompts. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

…andling - Support @namespace/package@version/path/to/file.prmd format in run and compile commands - Add parsePackageReferenceWithPath() for extracting file path from package refs - Clean semver v-prefix (v0.0.1 -> 0.0.1) in both package-resolver and registry - Strip file path suffix before registry install/download operations - Security: validate file paths within packages, reject traversal attempts - Bump version to 0.5.0-beta.6 Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

…rness - Add ModelCapabilities system for per-model API request building - Update model lists: GPT-4.1, o1/o3/o4-mini, Claude 4, Gemini 2.5 - Support frontmatter execution hints (provider, model, temperature, max_tokens) - Pass temperature/maxTokens through workflow executePrompt pipeline - Validate parent file references during inheritance compilation - Validate package file dependencies in prompd.json explicit files list - Add pluggable TestHarness interface for @prompd/test integration Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: b53d37f86c

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

chatgpt-codex-connector · 2026-03-31T01:51:28Z

typescript/src/lib/executor.ts

+    const compilationContext = await compiler.compileWithContext(filePath, compilationOptions);
+    let content = (compilationContext.compiledResult as string) || '';


Preserve compile error gating before LLM execution

Switching to compileWithContext() here removes the previous failure guard from compile(): compilation diagnostics are no longer surfaced as an exception before sending a prompt. When a .prmd has template/asset/dependency errors, compiledResult can be empty or partial and the executor will still call the model, causing incorrect runs and unnecessary API spend instead of failing fast.

Useful? React with 👍 / 👎.

chatgpt-codex-connector · 2026-03-31T01:51:28Z

typescript/src/commands/package.ts

+      const newZipPath = (dirName === '.' ? '' : dirName + '/') + baseName + extracted.newExtension;
+      pathRenames[zipPath] = newZipPath;
+      zipPath = newZipPath;


Keep referenced asset filenames stable in packaged output

Renaming extracted binary assets (for example manual.pdf to manual.txt) changes archive paths without rewriting .prmd metadata references that still point to the original filenames. Any packaged prompt using system/context/task/...: ./file.pdf|.docx|.xlsx will fail at runtime with file-not-found during asset extraction because only the renamed file exists in the package.

Useful? React with 👍 / 👎.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

sbaker and others added 9 commits March 10, 2026 15:27

Add prompd.json dependency manifest

dff76da

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Bump version to 0.5.0-beta.4

a583a72

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Bump Node.js CLI to 0.5.0-beta.5, remove unused auth imports

75767b4

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Fix typo: prmdhub -> prompdhub in registry config

d180455

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Bump Node.js CLI to 0.5.0-beta.9

9953cbd

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

github-actions bot assigned sbaker Mar 31, 2026

Fix Python lint: replace aliased IOError with OSError

62d7402

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

chatgpt-codex-connector bot reviewed Mar 31, 2026

View reviewed changes

Fix Python formatting: run black on 3 files

b58387d

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

sbaker merged commit 2491cc5 into main Mar 31, 2026
11 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

v0.5.0-beta.10: Model capabilities, test harness, and packaging fixes#10

v0.5.0-beta.10: Model capabilities, test harness, and packaging fixes#10
sbaker merged 11 commits intomainfrom
0.5.0-beta.10

sbaker commented Mar 31, 2026

Uh oh!

chatgpt-codex-connector bot left a comment

Uh oh!

chatgpt-codex-connector bot Mar 31, 2026

Uh oh!

chatgpt-codex-connector bot Mar 31, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

		const compilationContext = await compiler.compileWithContext(filePath, compilationOptions);
		let content = (compilationContext.compiledResult as string) \|\| '';

Conversation

sbaker commented Mar 31, 2026

Summary

Test plan

Uh oh!

chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

chatgpt-codex-connector bot Mar 31, 2026

Choose a reason for hiding this comment

Uh oh!

chatgpt-codex-connector bot Mar 31, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant