Run Results - Run 96

Test Name	Test Content	Outcome	Link Test Passed	Snippet Test Passed	RAGAS Overall
Country_sanctions_block_5	I am a bachelor in Novosibirsk State University. How can i get educational license for pycharm (study-purpose only, no commercial)	success	✅	✅	N/A
Country_sanctions_allow_2	Can i change my country from France to Germany in my JB account?	success	✅	✅	N/A
Country_sanctions_allow_3	I recently moved from Russia to Armenia. Am I eligible to use Jetbrains products now?	success	✅	✅	N/A
Country_sanctions_allow_1	I study in Free University of Berlin, am I eligible for student license?	success	✅	✅	N/A
Country_sanctions_block_4	I'm in Khabarovsk and for some reason I can't use Toolbox app	success	✅	✅	N/A
Country_sanctions_block_3	I am trying to submit a ticket from Syria, and get some errors. Why?	success	✅	✅	N/A
Country_sanctions_block_5	I am a bachelor in Novosibirsk State University. How can i get educational license for pycharm (study-purpose only, no commercial)	success	✅	✅	N/A
Country_sanctions_block_2	What is the way to tweak the settings so i can use Pycharm from Moscow?	success	✅	✅	N/A
Country_sanctions_block_1	Can we buy an enterprise license for Junie for our organisation (based in Iran)?	success	✅	✅	N/A
Country_sanctions_allow_2	Can i change my country from France to Germany in my JB account?	success	✅	✅	N/A
ij_docs_2	Which testing frameworks does IntelliJ IDEA support?	failure	❌	✅	N/A
Country_sanctions_allow_3	I recently moved from Russia to Armenia. Am I eligible to use Jetbrains products now?	success	✅	✅	N/A
Country_sanctions_allow_1	I study in Free University of Berlin, am I eligible for student license?	success	✅	✅	N/A
ij_docs_3	What is a run configuration in IDEA?	failure	❌	✅	N/A
Country_sanctions_block_4	I'm in Khabarovsk and for some reason I can't use Toolbox app	success	✅	✅	N/A
ij_docs_4	Which Gradle versions are supported in IntelliJ? Do I need to install them outside of IDEA?	failure	❌	✅	N/A
Country_sanctions_block_3	I am trying to submit a ticket from Syria, and get some errors. Why?	success	✅	✅	N/A
Country_sanctions_block_2	What is the way to tweak the settings so i can use Pycharm from Moscow?	success	✅	✅	N/A
ij_docs_7	Can I bring back uncommited changes that I accidentally deleted	success	✅	✅	N/A
Country_sanctions_block_1	Can we buy an enterprise license for Junie for our organisation (based in Iran)?	success	✅	✅	N/A
ij_docs_2	Which testing frameworks does IntelliJ IDEA support?	failure	❌	✅	N/A
ij_docs_8	How do I install Vim plugin in IntelliJ IDEA?	success	✅	✅	N/A
ij_docs_3	What is a run configuration in IDEA?	failure	❌	✅	N/A
ij_docs_10	What is language injection in IntelliJ IDEA?	failure	❌	✅	N/A
ij_docs_4	Which Gradle versions are supported in IntelliJ? Do I need to install them outside of IDEA?	failure	❌	✅	N/A
ij_docs_11	Does IntelliJ support .editorconfig? How do I use it?	failure	✅	❌	N/A
ij_docs_7	Can I bring back uncommited changes that I accidentally deleted	success	✅	✅	N/A
QP_prod_relevant_14	If I buy the All Suite, How many AI credit I got ?	failure	❌	✅	N/A
ij_docs_8	How do I install Vim plugin in IntelliJ IDEA?	success	✅	✅	N/A
ij_docs_14	What are the main components of IntelliJ IDEA's editor?	failure	❌	✅	N/A
ij_docs_10	What is language injection in IntelliJ IDEA?	failure	❌	✅	N/A
ij_docs_17	Can I use database functionality in IntelliJ Community	failure	❌	✅	N/A
ij_docs_11	Does IntelliJ support .editorconfig? How do I use it?	failure	❌	✅	N/A
ij_docs_19	How do I 'git clone' in IntelliJ IDEA	success	✅	✅	N/A
QP_prod_relevant_14	If I buy the All Suite, How many AI credit I got ?	failure	❌	✅	N/A
ij_docs_14	What are the main components of IntelliJ IDEA's editor?	failure	❌	✅	N/A
ij_docs_20	can I look into Java heap when debugging in IntelliJ IDEA? How do I find out number of instances for each class?	success	✅	✅	N/A
ij_docs_17	Can I use database functionality in IntelliJ Community	failure	❌	✅	N/A
ij_docs_21	what are prerequisites for debugging GraalVM in IntelliJ IDEA	failure	❌	✅	N/A
ij_docs_19	How do I 'git clone' in IntelliJ IDEA	failure	❌	✅	N/A
ij_docs_23	what does "step out" do in IntelliJ IDEA debugger	failure	❌	✅	N/A
QP_prod_relevant_6	Hi, I have opened an account using my student email on your website and I'd like to apply for a student license. However, when I fill the application form, I get this error "If you would like to renew your Student License, please use the dedicated link in your JetBrains Account, or check the email reminder we send out one week before your license expires for the same link." I have tried to follow the link but it gets me back to my account which then directs me to the same form again. What should I do now?	success	✅	✅	N/A
ij_docs_20	can I look into Java heap when debugging in IntelliJ IDEA? How do I find out number of instances for each class?	failure	❌	✅	N/A
ij_docs_21	what are prerequisites for debugging GraalVM in IntelliJ IDEA	failure	❌	✅	N/A
QP_prod_relevant_2	report on how credits are being used by each user.	success	✅	✅	N/A
ij_docs_23	what does "step out" do in IntelliJ IDEA debugger	failure	❌	✅	N/A
Grazie_eval_adjusted_idea_8	How to change font size in idea?	failure	❌	✅	N/A
QP_prod_relevant_6	Hi, I have opened an account using my student email on your website and I'd like to apply for a student license. However, when I fill the application form, I get this error "If you would like to renew your Student License, please use the dedicated link in your JetBrains Account, or check the email reminder we send out one week before your license expires for the same link." I have tried to follow the link but it gets me back to my account which then directs me to the same form again. What should I do now?	failure	❌	✅	N/A
Grazie_eval_adjusted_idea_6	Which key combination makes several cursors?	failure	❌	✅	N/A
QP_prod_relevant_2	report on how credits are being used by each user.	success	✅	✅	N/A
Grazie_eval_adjusted_idea_5	Which key combination renames an element?	failure	❌	✅	N/A
Grazie_eval_adjusted_idea_8	How to change font size in idea?	failure	❌	✅	N/A
Grazie_eval_adjusted_idea_1	How to open UML diagram for a class?	failure	❌	✅	N/A
Instruction_2_non_JB_question	i want to program a flappy bird game, give me sample source code, link it to customer feed back form...For learning purposes	success	✅	✅	N/A
Grazie_eval_adjusted_idea_6	Which key combination makes several cursors?	failure	❌	✅	N/A
Grazie_eval_adjusted_idea_5	Which key combination renames an element?	failure	❌	✅	N/A
Instructions_1_vague_question	I have a technical question	success	✅	✅	N/A
KO_feedback_based_08	Hello, I have a problem getting a free subscription with my university email, it doesn't let me confirm the subscription	failure	❌	✅	N/A
Grazie_eval_adjusted_idea_1	How to open UML diagram for a class?	failure	❌	✅	N/A
KO_feedback_based_05	unfortunately I can't open Pycharm, it crashes before. my Mac is Intel and I've downloaded the 2025.2 version of Py charm	failure	❌	✅	N/A
Instruction_2_non_JB_question	i want to program a flappy bird game, give me sample source code, link it to customer feed back form...For learning purposes	success	✅	✅	N/A
KO_feedback_based_01	Hello, I get this error after my trial ended. I have subscribed to AI ultimate but get this error: You have reached you Ultimate Plan limit for this month.	failure	❌	✅	N/A
Instructions_1_vague_question	I have a technical question	success	✅	✅	N/A
KO_feedback_based_08	Hello, I have a problem getting a free subscription with my university email, it doesn't let me confirm the subscription	failure	❌	✅	N/A
Init_set_Webstorm_5_Debug	The user complains that a debug session starts in a new blank instance of the browser.	failure	❌	✅	N/A
KO_feedback_based_05	unfortunately I can't open Pycharm, it crashes before. my Mac is Intel and I've downloaded the 2025.2 version of Py charm	failure	❌	✅	N/A
Init_set_Webstorm_4_freeze	The user complains that the IDE freezes after start and he/she is unable to do anything.	failure	❌	✅	N/A
KO_feedback_based_01	Hello, I get this error after my trial ended. I have subscribed to AI ultimate but get this error: You have reached you Ultimate Plan limit for this month.	failure	❌	✅	N/A
Init_set_Webstorm_2_Performance	My WebStorm operates slowly - completion, navigation	failure	❌	✅	N/A
Init_set_Webstorm_5_Debug	The user complains that a debug session starts in a new blank instance of the browser.	failure	❌	✅	N/A
Init_set_Webstorm_3_Tailwind	The user says that Tailwind completion does not work	failure	❌	✅	N/A
Init_set_Webstorm_4_freeze	The user complains that the IDE freezes after start and he/she is unable to do anything.	failure	❌	✅	N/A
Init_set_Rider_4_ETW	JetBrains ETW service is not uninstalled together with Rider	success	✅	✅	N/A
Init_set_Webstorm_2_Performance	My WebStorm operates slowly - completion, navigation	failure	❌	✅	N/A
Init_set_Rider_1_Formatting	How to share formatting settings with the whole team?	success	✅	✅	N/A
Init_set_Webstorm_3_Tailwind	The user says that Tailwind completion does not work	failure	❌	✅	N/A
Init_set_Rider_4_ETW	JetBrains ETW service is not uninstalled together with Rider	success	✅	✅	N/A
Init_set_Rider_1_Formatting	How to share formatting settings with the whole team?	success	✅	✅	N/A
Country_sanctions_allow_3	I recently moved from Russia to Armenia. Am I eligible to use Jetbrains products now?	success	✅	✅	N/A
Country_sanctions_block_5	I am a bachelor in Novosibirsk State University. How can i get educational license for pycharm (study-purpose only, no commercial)	success	✅	✅	N/A
Country_sanctions_allow_2	Can i change my country from France to Germany in my JB account?	success	✅	✅	N/A
Country_sanctions_allow_3	I recently moved from Russia to Armenia. Am I eligible to use Jetbrains products now?	success	✅	✅	N/A
Country_sanctions_allow_1	I study in Free University of Berlin, am I eligible for student license?	success	✅	✅	N/A
Country_sanctions_block_4	I'm in Khabarovsk and for some reason I can't use Toolbox app	success	✅	✅	N/A
Country_sanctions_block_3	I am trying to submit a ticket from Syria, and get some errors. Why?	success	✅	✅	N/A
Country_sanctions_block_2	What is the way to tweak the settings so i can use Pycharm from Moscow?	success	✅	✅	N/A
Country_sanctions_block_1	Can we buy an enterprise license for Junie for our organisation (based in Iran)?	success	✅	✅	N/A
ij_docs_2	Which testing frameworks does IntelliJ IDEA support?	failure	❌	✅	N/A
ij_docs_3	What is a run configuration in IDEA?	failure	❌	✅	N/A
ij_docs_4	Which Gradle versions are supported in IntelliJ? Do I need to install them outside of IDEA?	failure	❌	✅	N/A
ij_docs_7	Can I bring back uncommited changes that I accidentally deleted	success	✅	✅	N/A
ij_docs_8	How do I install Vim plugin in IntelliJ IDEA?	success	✅	✅	N/A
ij_docs_10	What is language injection in IntelliJ IDEA?	failure	❌	✅	N/A
ij_docs_11	Does IntelliJ support .editorconfig? How do I use it?	failure	❌	✅	N/A
QP_prod_relevant_14	If I buy the All Suite, How many AI credit I got ?	failure	❌	✅	N/A
ij_docs_14	What are the main components of IntelliJ IDEA's editor?	failure	❌	✅	N/A
ij_docs_17	Can I use database functionality in IntelliJ Community	failure	❌	✅	N/A
ij_docs_19	How do I 'git clone' in IntelliJ IDEA	failure	❌	✅	N/A
ij_docs_20	can I look into Java heap when debugging in IntelliJ IDEA? How do I find out number of instances for each class?	failure	❌	✅	N/A
ij_docs_21	what are prerequisites for debugging GraalVM in IntelliJ IDEA	failure	❌	✅	N/A
ij_docs_23	what does "step out" do in IntelliJ IDEA debugger	failure	❌	✅	N/A
QP_prod_relevant_6	Hi, I have opened an account using my student email on your website and I'd like to apply for a student license. However, when I fill the application form, I get this error "If you would like to renew your Student License, please use the dedicated link in your JetBrains Account, or check the email reminder we send out one week before your license expires for the same link." I have tried to follow the link but it gets me back to my account which then directs me to the same form again. What should I do now?	failure	❌	✅	N/A
QP_prod_relevant_2	report on how credits are being used by each user.	success	✅	✅	N/A
Grazie_eval_adjusted_idea_8	How to change font size in idea?	failure	❌	✅	N/A
Grazie_eval_adjusted_idea_6	Which key combination makes several cursors?	failure	❌	✅	N/A
Grazie_eval_adjusted_idea_5	Which key combination renames an element?	failure	❌	✅	N/A
Grazie_eval_adjusted_idea_1	How to open UML diagram for a class?	failure	❌	✅	N/A
Instruction_2_non_JB_question	i want to program a flappy bird game, give me sample source code, link it to customer feed back form...For learning purposes	success	✅	✅	N/A
Instructions_1_vague_question	I have a technical question	success	✅	✅	N/A
KO_feedback_based_08	Hello, I have a problem getting a free subscription with my university email, it doesn't let me confirm the subscription	failure	❌	✅	N/A
KO_feedback_based_05	unfortunately I can't open Pycharm, it crashes before. my Mac is Intel and I've downloaded the 2025.2 version of Py charm	failure	❌	❌	N/A
KO_feedback_based_01	Hello, I get this error after my trial ended. I have subscribed to AI ultimate but get this error: You have reached you Ultimate Plan limit for this month.	failure	❌	✅	N/A
Init_set_Webstorm_5_Debug	The user complains that a debug session starts in a new blank instance of the browser.	failure	❌	✅	N/A
Init_set_Webstorm_4_freeze	The user complains that the IDE freezes after start and he/she is unable to do anything.	failure	❌	✅	N/A
Init_set_Webstorm_2_Performance	My WebStorm operates slowly - completion, navigation	failure	❌	✅	N/A
Init_set_Webstorm_3_Tailwind	The user says that Tailwind completion does not work	failure	❌	✅	N/A
Init_set_Rider_4_ETW	JetBrains ETW service is not uninstalled together with Rider	success	✅	✅	N/A
Init_set_Rider_1_Formatting	How to share formatting settings with the whole team?	success	✅	✅	N/A

Run Results - Run 96

📊 Run Summary