mirror of
https://github.com/AutoMaker-Org/automaker.git
synced 2026-03-17 10:03:08 +00:00
* fix(copilot): correct tool.execution_complete event handling The CopilotProvider was using incorrect event type and data structure for tool execution completion events from the @github/copilot-sdk, causing tool call outputs to be empty. Changes: - Update event type from 'tool.execution_end' to 'tool.execution_complete' - Fix data structure to use nested result.content instead of flat result - Fix error structure to use error.message instead of flat error - Add success field to match SDK event structure - Add tests for empty and missing result handling This aligns with the official @github/copilot-sdk v0.1.16 types defined in session-events.d.ts. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * test(copilot): add edge case test for error with code field Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * refactor(copilot): improve error handling and code quality Code review improvements: - Extract magic string '[ERROR]' to TOOL_ERROR_PREFIX constant - Add null-safe error handling with direct error variable assignment - Include error codes in error messages for better debugging - Add JSDoc documentation for tool.execution_complete handler - Update tests to verify error codes are displayed - Add missing tool_use_id assertion in error test These changes improve: - Code maintainability (no magic strings) - Debugging experience (error codes now visible) - Type safety (explicit null checks) - Test coverage (verify error code formatting) Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * Changes from fix/bug-fixes-1-0 * test(copilot): add edge case test for error with code field Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * Changes from fix/bug-fixes-1-0 * fix: Handle detached HEAD state in worktree discovery and recovery * fix: Remove unused isDevServerStarting prop and md: breakpoint classes * fix: Add missing dependency and sanitize persisted cache data * feat: Ensure NODE_ENV is set to test in vitest configs * feat: Configure Playwright to run only E2E tests * fix: Improve PR tracking and dev server lifecycle management * feat: Add settings-based defaults for planning mode, model config, and custom providers. Fixes #816 * feat: Add worktree and branch selector to graph view * fix: Add timeout and error handling for worktree HEAD ref resolution * fix: use absolute icon path and place icon outside asar on Linux The hicolor icon theme index only lists sizes up to 512x512, so an icon installed only at 1024x1024 is invisible to GNOME/KDE's theme resolver, causing both the app launcher and taskbar to show a generic icon. Additionally, BrowserWindow.icon cannot be read by the window manager when the file is inside app.asar. - extraResources: copy logo_larger.png to resources/ (outside asar) so it lands at /opt/Automaker/resources/logo_larger.png on install - linux.desktop.Icon: set to the absolute resources path, bypassing the hicolor theme lookup and its size constraints entirely - icon-manager.ts: on Linux production use process.resourcesPath so BrowserWindow receives a real filesystem path the WM can read directly Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * fix: use linux.desktop.entry for custom desktop Icon field electron-builder v26 rejects arbitrary keys in linux.desktop — the correct schema wraps custom .desktop overrides inside desktop.entry. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * fix: set desktop name on Linux so taskbar uses the correct app icon Without app.setDesktopName(), the window manager cannot associate the running Electron process with automaker.desktop. GNOME/KDE fall back to _NET_WM_ICON which defaults to Electron's own bundled icon. Calling app.setDesktopName('automaker.desktop') before any window is created sets the _GTK_APPLICATION_ID hint and XDG app_id so the WM picks up the desktop entry's Icon for the taskbar. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * Fix: memory and context views mobile friendly (#818) * Changes from fix/memory-and-context-mobile-friendly * fix: Improve file extension detection and add path traversal protection * refactor: Extract file extension utilities and add path traversal guards Code review improvements: - Extract isMarkdownFilename and isImageFilename to shared image-utils.ts - Remove duplicated code from context-view.tsx and memory-view.tsx - Add path traversal guard for context fixture utilities (matching memory) - Add 7 new tests for context fixture path traversal protection - Total 61 tests pass Addresses code review feedback from PR #813 Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * test: Add e2e tests for profiles crud and board background persistence * Update apps/ui/playwright.config.ts Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * fix: Add robust test navigation handling and file filtering * fix: Format NODE_OPTIONS configuration on single line * test: Update profiles and board background persistence tests * test: Replace iPhone 13 Pro with Pixel 5 for mobile test consistency * Update apps/ui/src/components/views/context-view.tsx Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * chore: Remove test project directory * feat: Filter context files by type and improve mobile menu visibility --------- Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * fix: Improve test reliability and localhost handling * chore: Use explicit TEST_USE_EXTERNAL_BACKEND env var for server cleanup * feat: Add E2E/CI mock mode for provider factory and auth verification * feat: Add remoteBranch parameter to pull and rebase operations * chore: Enhance E2E testing setup with worker isolation and auth state management - Updated .gitignore to include worker-specific test fixtures. - Modified e2e-tests.yml to implement test sharding for improved CI performance. - Refactored global setup to authenticate once and save session state for reuse across tests. - Introduced worker-isolated fixture paths to prevent conflicts during parallel test execution. - Improved test navigation and loading handling for better reliability. - Updated various test files to utilize new auth state management and fixture paths. * fix: Update Playwright configuration and improve test reliability - Increased the number of workers in Playwright configuration for better parallelism in CI environments. - Enhanced the board background persistence test to ensure dropdown stability by waiting for the list to populate before interaction, improving test reliability. * chore: Simplify E2E test configuration and enhance mock implementations - Updated e2e-tests.yml to run tests in a single shard for streamlined CI execution. - Enhanced unit tests for worktree list handling by introducing a mock for execGitCommand, improving test reliability and coverage. - Refactored setup functions to better manage command mocks for git operations in tests. - Improved error handling in mkdirSafe function to account for undefined stats in certain environments. * refactor: Improve test configurations and enhance error handling - Updated Playwright configuration to clear VITE_SERVER_URL, ensuring the frontend uses the Vite proxy and preventing cookie domain mismatches. - Enhanced MergeRebaseDialog logic to normalize selectedBranch for better handling of various ref formats. - Improved global setup with a more robust backend health check, throwing an error if the backend is not healthy after retries. - Refactored project creation tests to handle file existence checks more reliably. - Added error handling for missing E2E source fixtures to guide setup process. - Enhanced memory navigation to handle sandbox dialog visibility more effectively. * refactor: Enhance Git command execution and improve test configurations - Updated Git command execution to merge environment paths correctly, ensuring proper command execution context. - Refactored the Git initialization process to handle errors more gracefully and ensure user configuration is set before creating the initial commit. - Improved test configurations by updating Playwright test identifiers for better clarity and consistency across different project states. - Enhanced cleanup functions in tests to handle directory removal more robustly, preventing errors during test execution. * fix: Resolve React hooks errors from duplicate instances in dependency tree * style: Format alias configuration for improved readability --------- Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Co-authored-by: DhanushSantosh <dhanushsantoshs05@gmail.com> Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
273 lines
8.6 KiB
TypeScript
273 lines
8.6 KiB
TypeScript
import { describe, it, expect, beforeEach } from 'vitest';
|
|
import { GeminiProvider } from '@/providers/gemini-provider.js';
|
|
import type { ProviderMessage } from '@automaker/types';
|
|
import { validateBareModelId } from '@automaker/types';
|
|
|
|
describe('gemini-provider.ts', () => {
|
|
let provider: GeminiProvider;
|
|
|
|
beforeEach(() => {
|
|
provider = new GeminiProvider();
|
|
});
|
|
|
|
describe('buildCliArgs', () => {
|
|
it('should include --prompt with empty string to force headless mode', () => {
|
|
const args = provider.buildCliArgs({
|
|
prompt: 'Hello from Gemini',
|
|
model: '2.5-flash',
|
|
cwd: '/tmp/project',
|
|
});
|
|
|
|
const promptIndex = args.indexOf('--prompt');
|
|
expect(promptIndex).toBeGreaterThan(-1);
|
|
expect(args[promptIndex + 1]).toBe('');
|
|
});
|
|
|
|
it('should include --resume when sdkSessionId is provided', () => {
|
|
const args = provider.buildCliArgs({
|
|
prompt: 'Hello',
|
|
model: '2.5-flash',
|
|
cwd: '/tmp/project',
|
|
sdkSessionId: 'gemini-session-123',
|
|
});
|
|
|
|
const resumeIndex = args.indexOf('--resume');
|
|
expect(resumeIndex).toBeGreaterThan(-1);
|
|
expect(args[resumeIndex + 1]).toBe('gemini-session-123');
|
|
});
|
|
|
|
it('should not include --resume when sdkSessionId is missing', () => {
|
|
const args = provider.buildCliArgs({
|
|
prompt: 'Hello',
|
|
model: '2.5-flash',
|
|
cwd: '/tmp/project',
|
|
});
|
|
|
|
expect(args).not.toContain('--resume');
|
|
});
|
|
|
|
it('should include --sandbox false for faster execution', () => {
|
|
const args = provider.buildCliArgs({
|
|
prompt: 'Hello',
|
|
model: '2.5-flash',
|
|
cwd: '/tmp/project',
|
|
});
|
|
|
|
const sandboxIndex = args.indexOf('--sandbox');
|
|
expect(sandboxIndex).toBeGreaterThan(-1);
|
|
expect(args[sandboxIndex + 1]).toBe('false');
|
|
});
|
|
|
|
it('should include --approval-mode yolo for non-interactive use', () => {
|
|
const args = provider.buildCliArgs({
|
|
prompt: 'Hello',
|
|
model: '2.5-flash',
|
|
cwd: '/tmp/project',
|
|
});
|
|
|
|
const approvalIndex = args.indexOf('--approval-mode');
|
|
expect(approvalIndex).toBeGreaterThan(-1);
|
|
expect(args[approvalIndex + 1]).toBe('yolo');
|
|
});
|
|
|
|
it('should include --output-format stream-json', () => {
|
|
const args = provider.buildCliArgs({
|
|
prompt: 'Hello',
|
|
model: '2.5-flash',
|
|
cwd: '/tmp/project',
|
|
});
|
|
|
|
const formatIndex = args.indexOf('--output-format');
|
|
expect(formatIndex).toBeGreaterThan(-1);
|
|
expect(args[formatIndex + 1]).toBe('stream-json');
|
|
});
|
|
|
|
it('should include --include-directories with cwd', () => {
|
|
const args = provider.buildCliArgs({
|
|
prompt: 'Hello',
|
|
model: '2.5-flash',
|
|
cwd: '/tmp/my-project',
|
|
});
|
|
|
|
const dirIndex = args.indexOf('--include-directories');
|
|
expect(dirIndex).toBeGreaterThan(-1);
|
|
expect(args[dirIndex + 1]).toBe('/tmp/my-project');
|
|
});
|
|
|
|
it('should add gemini- prefix to bare model names', () => {
|
|
const args = provider.buildCliArgs({
|
|
prompt: 'Hello',
|
|
model: '2.5-flash',
|
|
cwd: '/tmp/project',
|
|
});
|
|
|
|
const modelIndex = args.indexOf('--model');
|
|
expect(modelIndex).toBeGreaterThan(-1);
|
|
expect(args[modelIndex + 1]).toBe('gemini-2.5-flash');
|
|
});
|
|
|
|
it('should not double-prefix model names that already have gemini-', () => {
|
|
const args = provider.buildCliArgs({
|
|
prompt: 'Hello',
|
|
model: 'gemini-2.5-pro',
|
|
cwd: '/tmp/project',
|
|
});
|
|
|
|
const modelIndex = args.indexOf('--model');
|
|
expect(modelIndex).toBeGreaterThan(-1);
|
|
expect(args[modelIndex + 1]).toBe('gemini-2.5-pro');
|
|
});
|
|
});
|
|
|
|
describe('normalizeEvent - error handling', () => {
|
|
it('returns error from result event when status=error and error field is set', () => {
|
|
const event = {
|
|
type: 'result',
|
|
status: 'error',
|
|
error: 'Model overloaded',
|
|
session_id: 'sess-gemini-1',
|
|
stats: { duration_ms: 4000, total_tokens: 0 },
|
|
};
|
|
|
|
const msg = provider.normalizeEvent(event) as ProviderMessage;
|
|
|
|
expect(msg).not.toBeNull();
|
|
expect(msg.type).toBe('error');
|
|
expect(msg.error).toBe('Model overloaded');
|
|
expect(msg.session_id).toBe('sess-gemini-1');
|
|
});
|
|
|
|
it('builds diagnostic fallback when result event has status=error but empty error field', () => {
|
|
const event = {
|
|
type: 'result',
|
|
status: 'error',
|
|
error: '',
|
|
session_id: 'sess-gemini-2',
|
|
stats: { duration_ms: 7500, total_tokens: 0 },
|
|
};
|
|
|
|
const msg = provider.normalizeEvent(event) as ProviderMessage;
|
|
|
|
expect(msg).not.toBeNull();
|
|
expect(msg.type).toBe('error');
|
|
// Diagnostic info should be present instead of 'Unknown error'
|
|
expect(msg.error).toContain('7500ms');
|
|
expect(msg.error).toContain('sess-gemini-2');
|
|
expect(msg.error).not.toBe('Unknown error');
|
|
});
|
|
|
|
it('builds fallback with "unknown" duration when stats are missing', () => {
|
|
const event = {
|
|
type: 'result',
|
|
status: 'error',
|
|
error: '',
|
|
session_id: 'sess-gemini-nostats',
|
|
// no stats field
|
|
};
|
|
|
|
const msg = provider.normalizeEvent(event) as ProviderMessage;
|
|
|
|
expect(msg).not.toBeNull();
|
|
expect(msg.type).toBe('error');
|
|
expect(msg.error).toContain('unknown');
|
|
});
|
|
|
|
it('returns error from standalone error event with error field set', () => {
|
|
const event = {
|
|
type: 'error',
|
|
error: 'API key invalid',
|
|
session_id: 'sess-gemini-3',
|
|
};
|
|
|
|
const msg = provider.normalizeEvent(event) as ProviderMessage;
|
|
|
|
expect(msg).not.toBeNull();
|
|
expect(msg.type).toBe('error');
|
|
expect(msg.error).toBe('API key invalid');
|
|
});
|
|
|
|
it('builds diagnostic fallback when standalone error event has empty error field', () => {
|
|
const event = {
|
|
type: 'error',
|
|
error: '',
|
|
session_id: 'sess-gemini-empty',
|
|
};
|
|
|
|
const msg = provider.normalizeEvent(event) as ProviderMessage;
|
|
|
|
expect(msg).not.toBeNull();
|
|
expect(msg.type).toBe('error');
|
|
// Should include session_id, not just 'Unknown error'
|
|
expect(msg.error).toContain('sess-gemini-empty');
|
|
expect(msg.error).not.toBe('Unknown error');
|
|
});
|
|
|
|
it('builds fallback mentioning "none" when session_id is missing from error event', () => {
|
|
const event = {
|
|
type: 'error',
|
|
error: '',
|
|
// no session_id
|
|
};
|
|
|
|
const msg = provider.normalizeEvent(event) as ProviderMessage;
|
|
|
|
expect(msg).not.toBeNull();
|
|
expect(msg.type).toBe('error');
|
|
expect(msg.error).toContain('none');
|
|
});
|
|
|
|
it('uses consistent "Gemini agent failed" label for both result and error event fallbacks', () => {
|
|
const resultEvent = {
|
|
type: 'result',
|
|
status: 'error',
|
|
error: '',
|
|
session_id: 'sess-r',
|
|
stats: { duration_ms: 1000 },
|
|
};
|
|
const errorEvent = {
|
|
type: 'error',
|
|
error: '',
|
|
session_id: 'sess-e',
|
|
};
|
|
|
|
const resultMsg = provider.normalizeEvent(resultEvent) as ProviderMessage;
|
|
const errorMsg = provider.normalizeEvent(errorEvent) as ProviderMessage;
|
|
|
|
// Both fallback messages should use the same "Gemini agent failed" prefix
|
|
expect(resultMsg.error).toContain('Gemini agent failed');
|
|
expect(errorMsg.error).toContain('Gemini agent failed');
|
|
});
|
|
|
|
it('returns success result when result event has status=success', () => {
|
|
const event = {
|
|
type: 'result',
|
|
status: 'success',
|
|
error: '',
|
|
session_id: 'sess-gemini-ok',
|
|
stats: { duration_ms: 1200, total_tokens: 500 },
|
|
};
|
|
|
|
const msg = provider.normalizeEvent(event) as ProviderMessage;
|
|
|
|
expect(msg).not.toBeNull();
|
|
expect(msg.type).toBe('result');
|
|
expect(msg.subtype).toBe('success');
|
|
});
|
|
});
|
|
|
|
describe('validateBareModelId integration', () => {
|
|
it('should allow gemini- prefixed models for Gemini provider with expectedProvider="gemini"', () => {
|
|
expect(() =>
|
|
validateBareModelId('gemini-2.5-flash', 'GeminiProvider', 'gemini')
|
|
).not.toThrow();
|
|
expect(() => validateBareModelId('gemini-2.5-pro', 'GeminiProvider', 'gemini')).not.toThrow();
|
|
});
|
|
|
|
it('should reject other provider prefixes for Gemini provider', () => {
|
|
expect(() => validateBareModelId('cursor-gpt-4', 'GeminiProvider', 'gemini')).toThrow();
|
|
expect(() => validateBareModelId('codex-gpt-4', 'GeminiProvider', 'gemini')).toThrow();
|
|
expect(() => validateBareModelId('copilot-gpt-4', 'GeminiProvider', 'gemini')).toThrow();
|
|
});
|
|
});
|
|
});
|