Run Results - Run 61

Test Name	Test Content	Outcome	Link Test Passed	Snippet Test Passed	RAGAS Overall
ij_docs_14	What are the main components of IntelliJ IDEA's editor?	failure	❌	✅	N/A
ij_docs_15	How do I make Bazel run a Gazelle target before sync	success	✅	✅	N/A
ij_docs_16	What is the purpose of Bazel project views in IntelliJ IDEA	success	✅	✅	N/A
ij_docs_17	Can I use database functionality in IntelliJ Community	failure	❌	✅	N/A
ij_docs_17	How do I capture heap dump for a Java process in IntelliJ IDEA	success	✅	✅	N/A
ij_docs_18	how do I monitor live resource usage for an external Java process in IntelliJ IDEA	success	✅	✅	N/A
ij_docs_19	How do I 'git clone' in IntelliJ IDEA	failure	❌	✅	N/A
ij_docs_20	can I look into Java heap when debugging in IntelliJ IDEA? How do I find out number of instances for each class?	success	✅	✅	N/A
ij_docs_21	what are prerequisites for debugging GraalVM in IntelliJ IDEA	failure	❌	✅	N/A
ij_docs_22	what are HotSwap limitations in IntelliJ IDEA?	success	✅	✅	N/A
ij_docs_23	what does "step out" do in IntelliJ IDEA debugger	failure	❌	✅	N/A
QP_prod_relevant_10	is there a way to have a plugin just for specific projects?	success	✅	✅	N/A
QP_prod_relevant_9	If I use a free for commercial use product, but then want to make my program for commercial purposes, then I buy a commercial license, is it fine?	success	✅	✅	N/A
QP_prod_relevant_8	"Hi, is it possible to see how many ai credits each developer uses?"	success	✅	✅	N/A
QP_prod_relevant_6	Hi, I have opened an account using my student email on your website and I'd like to apply for a student license. However, when I fill the application form, I get this error "If you would like to renew your Student License, please use the dedicated link in your JetBrains Account, or check the email reminder we send out one week before your license expires for the same link." I have tried to follow the link but it gets me back to my account which then directs me to the same form again. What should I do now?	failure	❌	✅	N/A
QP_prod_relevant_5	i' m using ideal ultimate trial with my ai ultimate license, but junie stoped to work, ide and plugin is updated, ai plan is active, but no junie icon is show anymore, cant open the junie window	success	✅	✅	N/A
QP_prod_relevant_4	I'm looking for help to add my credit card to your site, so I can try the AI features for DataGrip.	success	✅	✅	N/A
QP_prod_relevant_3	Hi, I want to change my VAT ID	success	✅	✅	N/A
QP_prod_relevant_2	report on how credits are being used by each user.	failure	❌	✅	N/A
QP_prod_relevant_1	Hello, i'd like renew mi student license	success	✅	✅	N/A
Grazie_eval_adjusted_idea_9	How to use Emmet?	success	✅	✅	N/A
Grazie_eval_adjusted_idea_8	How to change font size in idea?	failure	❌	✅	N/A
Grazie_eval_adjusted_idea_7	How to format code in idea?	success	✅	✅	N/A
Grazie_eval_adjusted_idea_6	Which key combination makes several cursors?	failure	❌	✅	N/A
Grazie_eval_adjusted_idea_5	Which key combination renames an element?	failure	❌	✅	N/A
Grazie_eval_adjusted_idea_4	Can I use VCS in safe mode?	success	✅	✅	N/A
Grazie_eval_adjusted_idea_3	How to open presentation mode in idea?	success	✅	✅	N/A
Grazie_eval_adjusted_idea_2	How to give more memory to IDE?	success	✅	✅	N/A
Grazie_eval_adjusted_idea_10	Which icons are used for non-suspending breakpoints?	success	✅	✅	N/A
Grazie_eval_adjusted_idea_1	How to open UML diagram for a class?	failure	❌	✅	N/A
Grazie_eval_adjusted_fleet_12	What does the "environment" run configuration property do in Fleet?	failure	❌	✅	N/A
Grazie_eval_adjusted_fleet_11	How do I search for a file by name in Fleet?	failure	❌	✅	N/A
Grazie_eval_adjusted_fleet_10	How to set pytest as the test runner in Fleet?	failure	❌	✅	N/A
Grazie_eval_adjusted_fleet_8	How do I customize the editor appearance in fleet?	failure	❌	✅	N/A
Grazie_eval_adjusted_fleet_7	How do I navigate through code hierarchy in fleet?	failure	❌	✅	N/A
Grazie_eval_adjusted_fleet_6	How do I configure WSL in Fleet?	failure	❌	❌	N/A
Grazie_eval_adjusted_fleet_5	What are the keyboard shortcuts for navigating between tabs in fleet?	failure	❌	✅	N/A
Grazie_eval_adjusted_fleet_4	How to debug Python code in Fleet	failure	❌	✅	N/A
Grazie_eval_adjusted_fleet_3	Is there a live template for System.out.println in Fleet?	failure	❌	✅	N/A
Grazie_eval_adjusted_fleet_2	What steps are required to connect to a Docker container in Fleet?	failure	❌	❌	N/A
Grazie_eval_adjusted_fleet_1	How can I set breakpoints while debugging in Fleet?	failure	❌	✅	N/A
Instruction_2_non_JB_question	i want to program a flappy bird game, give me sample source code, link it to customer feed back form...For learning purposes	success	✅	✅	N/A
Instructions_1_vague_question	I have a technical question	success	✅	✅	N/A
KO_feedback_based_09	Hey, I have a recent MAC Sequoia 15.6 (24F74) and I can't manage to open the .dmg for datagrip	success	✅	✅	N/A
KO_feedback_based_08	Hello, I have a problem getting a free subscription with my university email, it doesn't let me confirm the subscription	failure	❌	✅	N/A
KO_feedback_based_07	I want to renew my student license, but I removed by accident link to renew my student pack. How I can renew?	success	✅	✅	N/A
KO_feedback_based_06	my company is trying to buy me a datagrip licence. when i try to put in billing information it defaults to the UK, but my company is a US company	success	✅	✅	N/A
KO_feedback_based_05	unfortunately I can't open Pycharm, it crashes before. my Mac is Intel and I've downloaded the 2025.2 version of Py charm	failure	❌	✅	N/A
KO_feedback_based_04	unable to add card	success	✅	✅	N/A
KO_feedback_based_03	i want to get a graduate discount	success	✅	✅	N/A
KO_feedback_based_02	What IDes does Junie support	success	✅	✅	N/A
KO_feedback_based_01	Hello, I get this error after my trial ended. I have subscribed to AI ultimate but get this error: You have reached you Ultimate Plan limit for this month.	failure	❌	✅	N/A
Init_set_Webstorm_1_KnownBug	I created a simple Angular project in Webstorm v20 with the CLI and included Karma tests. While running ng test works fine, I can't run a single or multiple tests in WebStorm. I get the following error in the runner: TypeError [ERR_INVALID_STATE]: Invalid state: Controller is already closed at ReadableStreamDefaultController.enqueue (node:internal/webstreams/readablestream:1077:13) at D:\Temp2025\ng20\node_modules@͏angular\build\src\builders\karma\application_builder.js:253:28 at Timeout.removeAllListeners [as _onTimeout] (D:\Temp2025\ng20\node_modules\karma\lib\server.js:468:9) at listOnTimeout (node:internal/timers:588:17) at process.processTimers (node:internal/timers:523:7) { code: 'ERR_INVALID_STATE'	success	✅	✅	N/A
Init_set_Junie_1_install	How to install Junie?	success	✅	✅	N/A
Init_set_Webstorm_5_Debug	The user complains that a debug session starts in a new blank instance of the browser.	success	✅	✅	N/A
Init_set_Webstorm_4_freeze	The user complains that the IDE freezes after start and he/she is unable to do anything.	failure	❌	✅	N/A
Init_set_Webstorm_2_Performance	My WebStorm operates slowly - completion, navigation	failure	❌	✅	N/A
Init_set_Webstorm_3_Tailwind	The user says that Tailwind completion does not work	failure	❌	✅	N/A
Init_set_Rider_4_ETW	JetBrains ETW service is not uninstalled together with Rider	success	✅	✅	N/A
Init_set_Rider_3_crash_I9	Rider crashes after opening a project in an Intel i9 CPU	success	✅	✅	N/A
Init_set_Rider_2_dotNet	Rider shows a lot of red code across the whole solution, .NET SDK symbols not resolved	success	✅	✅	N/A
Init_set_Rider_1_Formatting	How to share formatting settings with the whole team?	success	✅	✅	N/A

Run Results - Run 61

📊 Run Summary