Skip to content
Build and test extension

UI tests improvements (#153) #65

Sign in to view logs

UI tests improvements (#153)

UI tests improvements (#153) #65

GitHub Actions / Test Results failed Nov 27, 2024 in 0s

5 fail, 12 pass in 17m 21s

17 tests  +2   12 ✅  - 3   17m 21s ⏱️ + 14m 43s
 1 suites ±0    0 💤 ±0 
 1 files   ±0    5 ❌ +5 

Results for commit 5fb499c. ± Comparison against earlier commit 72af86b.

Annotations

Check warning on line 0 in Cody.VisualStudio.Tests.ChatLoggedBasicTests

See this annotation in the file changed.

@github-actions github-actions / Test Results

Active_File_Name_And_Line_Selection_Is_Showing_In_Chat_Input - 2022 Exp (Cody.VisualStudio.Tests.ChatLoggedBasicTests) failed 

TestResults\runneradmin_runner_2024-11-27_16_27_44.trx [took 30s]
Raw output 
System.TimeoutException : Timeout 30000ms exceeded.
Call log:
  - waiting for GetByRole(AriaRole.Button, new() { Name = "New Chat" })   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Microsoft.Playwright.Transport.Connection.<InnerSendMessageToServerAsync>d__40`1.MoveNext() in /_/src/Playwright/Transport/Connection.cs:line 206
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Microsoft.Playwright.Transport.Connection.<WrapApiCallAsync>d__52`1.MoveNext() in /_/src/Playwright/Transport/Connection.cs:line 532
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.GetResult()
   at Cody.VisualStudio.Tests.PlaywrightTestsBase.<NewChat>d__15.MoveNext() in C:\a\cody-vs\cody-vs\src\Cody.VisualStudio.Tests\PlaywrightTestsBase.cs:line 153
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.GetResult()
   at Cody.VisualStudio.Tests.ChatLoggedBasicTests.<Active_File_Name_And_Line_Selection_Is_Showing_In_Chat_Input>d__2.MoveNext() in C:\a\cody-vs\cody-vs\src\Cody.VisualStudio.Tests\ChatLoggedBasicTests.cs:line 34
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

Check warning on line 0 in Cody.VisualStudio.Tests.ChatLoggedBasicTests

See this annotation in the file changed.

@github-actions github-actions / Test Results

Active_File_Match_Current_Chat_Context - 2022 Exp (Cody.VisualStudio.Tests.ChatLoggedBasicTests) failed 

TestResults\runneradmin_runner_2024-11-27_16_27_44.trx [took 30s]
Raw output 
System.TimeoutException : Timeout 30000ms exceeded.
Call log:
  - waiting for GetByRole(AriaRole.Button, new() { Name = "New Chat" })   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Microsoft.Playwright.Transport.Connection.<InnerSendMessageToServerAsync>d__40`1.MoveNext() in /_/src/Playwright/Transport/Connection.cs:line 206
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Microsoft.Playwright.Transport.Connection.<WrapApiCallAsync>d__52`1.MoveNext() in /_/src/Playwright/Transport/Connection.cs:line 532
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.GetResult()
   at Cody.VisualStudio.Tests.PlaywrightTestsBase.<NewChat>d__15.MoveNext() in C:\a\cody-vs\cody-vs\src\Cody.VisualStudio.Tests\PlaywrightTestsBase.cs:line 153
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.GetResult()
   at Cody.VisualStudio.Tests.ChatLoggedBasicTests.<Active_File_Match_Current_Chat_Context>d__3.MoveNext() in C:\a\cody-vs\cody-vs\src\Cody.VisualStudio.Tests\ChatLoggedBasicTests.cs:line 56
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

Check warning on line 0 in Cody.VisualStudio.Tests.ChatLoggedBasicTests

See this annotation in the file changed.

@github-actions github-actions / Test Results

Entered_Prompt_Show_Up_In_Today_History - 2022 Exp (Cody.VisualStudio.Tests.ChatLoggedBasicTests) failed 

TestResults\runneradmin_runner_2024-11-27_16_27_44.trx [took 30s]
Raw output 
System.TimeoutException : Timeout 30000ms exceeded.
Call log:
  - waiting for Locator("span[data-lexical-text='true']")   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Microsoft.Playwright.Transport.Connection.<InnerSendMessageToServerAsync>d__40`1.MoveNext() in /_/src/Playwright/Transport/Connection.cs:line 206
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Microsoft.Playwright.Transport.Connection.<WrapApiCallAsync>d__52`1.MoveNext() in /_/src/Playwright/Transport/Connection.cs:line 532
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.GetResult()
   at Cody.VisualStudio.Tests.PlaywrightTestsBase.<EnterChatTextAndSend>d__20.MoveNext() in C:\a\cody-vs\cody-vs\src\Cody.VisualStudio.Tests\PlaywrightTestsBase.cs:line 175
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.GetResult()
   at Cody.VisualStudio.Tests.ChatLoggedBasicTests.<Entered_Prompt_Show_Up_In_Today_History>d__5.MoveNext() in C:\a\cody-vs\cody-vs\src\Cody.VisualStudio.Tests\ChatLoggedBasicTests.cs:line 95
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

Check warning on line 0 in Cody.VisualStudio.Tests.ChatNotLoggedStateTests

See this annotation in the file changed.

@github-actions github-actions / Test Results

Cody_Enterprise_Section_Is_Present - 2022 Exp (Cody.VisualStudio.Tests.ChatNotLoggedStateTests) failed 

TestResults\runneradmin_runner_2024-11-27_16_27_44.trx [took 4s]
Raw output 
System.InvalidOperationException : Sequence contains no elements   at System.Linq.Enumerable.First[TSource](IEnumerable`1 source)
   at Cody.VisualStudio.Tests.PlaywrightTestsBase.<AssertTextIsPresent>d__13.MoveNext() in C:\a\cody-vs\cody-vs\src\Cody.VisualStudio.Tests\PlaywrightTestsBase.cs:line 142
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.GetResult()
   at Cody.VisualStudio.Tests.ChatNotLoggedStateTests.<>c__DisplayClass4_0.<<Cody_Enterprise_Section_Is_Present>b__0>d.MoveNext() in C:\a\cody-vs\cody-vs\src\Cody.VisualStudio.Tests\ChatNotLoggedStateTests.cs:line 51
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.GetResult()
   at Cody.VisualStudio.Tests.ChatNotLoggedStateTests.<NotInLoggedState>d__6.MoveNext() in C:\a\cody-vs\cody-vs\src\Cody.VisualStudio.Tests\ChatNotLoggedStateTests.cs:line 77
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at Cody.VisualStudio.Tests.ChatNotLoggedStateTests.<NotInLoggedState>d__6.MoveNext() in C:\a\cody-vs\cody-vs\src\Cody.VisualStudio.Tests\ChatNotLoggedStateTests.cs:line 82
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.GetResult()
   at Cody.VisualStudio.Tests.ChatNotLoggedStateTests.<Cody_Enterprise_Section_Is_Present>d__4.MoveNext() in C:\a\cody-vs\cody-vs\src\Cody.VisualStudio.Tests\ChatNotLoggedStateTests.cs:line 49
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

Check warning on line 0 in Cody.VisualStudio.Tests.ChatLoggedBasicTests

See this annotation in the file changed.

@github-actions github-actions / Test Results

Solution_Name_Is_Added_To_Chat_Input - 2022 Exp (Cody.VisualStudio.Tests.ChatLoggedBasicTests) failed 

TestResults\runneradmin_runner_2024-11-27_16_27_44.trx [took 1m 0s]
Raw output 
System.TimeoutException : Timeout 30000ms exceeded.
Call log:
  - waiting for GetByTestId("tab-chat")   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Microsoft.Playwright.Transport.Connection.<InnerSendMessageToServerAsync>d__40`1.MoveNext() in /_/src/Playwright/Transport/Connection.cs:line 206
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Microsoft.Playwright.Transport.Connection.<WrapApiCallAsync>d__52`1.MoveNext() in /_/src/Playwright/Transport/Connection.cs:line 532
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.GetResult()
   at Cody.VisualStudio.Tests.PlaywrightTestsBase.<ShowChatTab>d__14.MoveNext() in C:\a\cody-vs\cody-vs\src\Cody.VisualStudio.Tests\PlaywrightTestsBase.cs:line 147
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.GetResult()
   at Cody.VisualStudio.Tests.PlaywrightTestsBase.<GetChatContextTags>d__22.MoveNext() in C:\a\cody-vs\cody-vs\src\Cody.VisualStudio.Tests\PlaywrightTestsBase.cs:line 202
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()
   at Cody.VisualStudio.Tests.ChatLoggedBasicTests.<Solution_Name_Is_Added_To_Chat_Input>d__1.MoveNext() in C:\a\cody-vs\cody-vs\src\Cody.VisualStudio.Tests\ChatLoggedBasicTests.cs:line 23
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Test Results

17 tests found 

There are 17 tests, see "Raw output" for the full list of tests.
Raw output 
Cody.Core.Tests.CustomConfigurationTests ‑ Complex_JSON_Data_Should_Be_Serializable
Cody.Core.Tests.CustomConfigurationTests ‑ CustomConfiguration_Malformed_JSON_Should_Return_Null
Cody.Core.Tests.CustomConfigurationTests ‑ Simple_JSON_Data_Should_Be_Serializable
Cody.VisualStudio.Tests.ChatLoggedBasicTests ‑ Active_File_Match_Current_Chat_Context - 2022 Exp
Cody.VisualStudio.Tests.ChatLoggedBasicTests ‑ Active_File_Name_And_Line_Selection_Is_Showing_In_Chat_Input - 2022 Exp
Cody.VisualStudio.Tests.ChatLoggedBasicTests ‑ Can_Chat_Tool_Window_Be_Closed_And_Opened_Again - 2022 Exp
Cody.VisualStudio.Tests.ChatLoggedBasicTests ‑ Entered_Prompt_Show_Up_In_Today_History - 2022 Exp
Cody.VisualStudio.Tests.ChatLoggedBasicTests ‑ Solution_Name_Is_Added_To_Chat_Input - 2022 Exp
Cody.VisualStudio.Tests.ChatNotLoggedStateTests ‑ Cody_Enterprise_Section_Is_Present - 2022 Exp
Cody.VisualStudio.Tests.ChatNotLoggedStateTests ‑ Cody_Free_Cody_Pro_Section_Is_Present - 2022 Exp
Cody.VisualStudio.Tests.ChatNotLoggedStateTests ‑ Logins_With_GitLab_Google_Are_Present - 2022 Exp
Cody.VisualStudio.Tests.CodyPackageTests ‑ CodyPackage_Loaded_OnDemand - 2022 Exp
Cody.VisualStudio.Tests.CodyPackageTests ‑ CodyToolWindow_Activated - 2022 Exp
Cody.VisualStudio.Tests.CodyPackageTests ‑ Logger_Initialized_And_Info_MethodCalled - 2022 Exp
Cody.VisualStudio.Tests.PlaywrightInitializationTests ‑ Playwright_Connects_OvercCDP - 2022 Exp
VsixTesting.Instances ‑ 1. Preparing Instance
VsixTesting.Instances ‑ 2. Launching Instance
View more details on GitHub Actions