← Back to Overview

Run Results - Run 126

env: onprem-streaming | source: api

📊 Run Summary

Total Tests
122
Run Date
2026-04-24 15:13:17
Source
api
Bot Environment
onprem-streaming
Tags
-
✅ Success
104 (85%)
❌ Failure
18
🔗 Link Tests
107 (87%)
📝 Snippet Tests
117 (95%)
📈 RAGAS Overall
0.687 (69%, 121 samples)
Test Name Test Content Outcome Link Test Passed Snippet Test Passed RAGAS Overall Details
SB-977 What the heck are "AI credits", what are they used for and why happens if I ignore the "You ahve 0.0% of your Pro plan quote remaining." message? success 0.802
SB-916 I need information about the community version of pycharm success 0.750
SB-905 how do i update my datagrip version success 0.846
SB-8147 datagrip eats all my CPU success 0.671
SB-752 Hi, I got this message from my AI Assistant Chat on IntelliJ Ides 2025.2 ## AI Assistant ou have reached the weekly fair use volume of JetBrains AI. If you need to allocate some extra volume, please contact our support team I would like to know what happened success 0.754
SB-741 Hi, I already have Jetbrains AI Pro purchased with my company But somehow it is stuck in Trial mode in my IntelliJ success 0.448
SB-7302 Any idea when the new JavaScript Temporal object will appear in YouTrack's ECMAScript implementation? success 0.747
SB-725 AI Chat with local models via Ollama is not working in Rider success 0.491
SB-6980 if i want to migrate the data from jira to youtrack in cloud purchanse will i be supported for data migration> success 0.785
SB-6842 Hello, i need to fix authorization roles about my youtrack account. success 0.758
SB-6781 When I change my ticket status to "Done" i receive an error that it is not "Ready to be pulled". what is that, please halp success 0.801
SB-6058 nobleuplift@gmail.com YouTrack was deleted. I want to see if I cna restore it success 0.681
SB-5802 We are experiencing a total outage on our YouTrack instance: https://rankmi.myjetbrains.com/. success 0.573
SB-2221 i want to use pycharm on my laptop success 0.793
SB-2244 I guess that the Junie AI Plugin is noct working properly but using my crcedits for not working. What can I do? success 0.623
SB-2102 downloading pycharm success 0.674
SB-2078 I would like to know if in MACOS pycharm can handle without needing a bridge connection a test environment for IOS apps success 0.662
SB-2228 pycharm python console crashes if code.py exists success 0.836
SB-2372 I installed Rider, ran our software (from one of our installers). I can attach, but breakpoints are disabled, with a message that the source file is not found among the loaded symbol documents to confuse things more: some colleagues can debug and break fine, some (like me) cannot break... We are running a net472 x64 application success 0.716
SB-3649 does data grip free version have a terminal ? success 0.768
SB-3084 I add a new state type field in my helpdesk project. now almost full backlog is showing as unresolved. how can i fix it? I have deleted the fields but it didn't help success 0.789
SB-2850 Hi, how can i activate ai assistant in my phpstorm success 0.835
SB-2675 i have purchased an ai license but it doesnt activate in intellij success 0.748
SB-2562 i cant seem to access the AI assistant pannel on the right side of my IntelliJ IDEA app success 0.832
SB-2531 can i publish .net framework/wpf desktop applications using rider success 0.761
SB-1846 hi i cant see on migration dialog in rider migratcions project ...i update .net do Version 10 and after this update i cant see migrations projcet success 0.863
SB-1813 how do I know how much AI is remaining on my AI pro subscription? success 0.770
SB-1801 I'd like to know more about AI credits. How to view my usage and remaining credits? success 0.873
SB-1779 I'm having trouble logging into my student account on PyCharm Pro. I'm getting the following error: "Could not create an HTTP request handler to accept the authorization callback on any of these ports: 62,345-62,364. This can happen when the ports are used by other applications or there is another authorization process in progress." success 0.809
SB-1770 Can you remove the expoired service API Pro ? It prevents me using Junie trial failure 0.639
SB-2054 my license for ai ultimate in intellij is not recognized success 0.753
SB-1977 When creating a new project on PyCharm 2025.2, I cannot find the option "Playwright for Python" as showed in documentation success 0.691
SB-1939 I have a All Products Pack license and installed PyCharm, now I want to activate PyCharm Pro but nothing happens success 0.790
SB-1873 i want to start using AI assistent, was asked to add my creditcard, i did, and now It still asks for linkin my creditcard (using pycharm) success 0.747
SB-1702 I have a company AI Pro Licence. since yesterday I got the message "Due to Abuse, we are temporary enabled card verifikation. No charges Apply. Thanks for your understanding. Link card to your jetbrains account". I cant do that, because its a Company Licence. success 0.738
SB-1654 Running jupyter in Pycharm 2025.1.2 success 0.742
SB-1648 does JetBrains AI Pro work with intelliJ community edition? success 0.794
SB-1673 how do I use pycharm success 0.780
SB-1639 I want to activate my trial for PyCharm, but I do not have the option to choose this subscription. success 0.698
SB-1594 Is AI assistent free for student? success 0.741
SB-1591 I cannot activate AI assistant. It keeps saying the license has expired. BUt I have active license success 0.677
SB-1488 How can I review AI usage? success 0.531
SB-1401 I no longer get the functional commit modal in PyCharm success 0.850
SB-1367 yesterday my PyCharm worked normally. now the application wont open on my macbook success 0.607
SB-1342 I have a question about how variables are displayed in the PyCharm debugger success 0.735
SB-1338 which function arguments are possible in PyCharm Jupyter notebook success 0.843
SB-1267 I have pycharm and it needs my jetbrains account and I'm new here success 0.776
SB-1179 Have I activated my AI Pro 30 day free trial yet? success 0.909
SB-1110 "I've been using PyCharm Community Edition for over 6 months and have completed 37 projects from the Udemy Python Bootcamp. Several projects started having errors with the import turtle statement (from turtle import Turtle, Screen). I'm on Ver 3.13. How do I upgrade to fix this without losing all of my work? success 0.854
SB-1021 I need help with activating Junie license. Company that I work for bought organization license for Junie. I have my personal PhpStorm license. How to activate Junie license? success 0.710
Country_sanctions_block_5 I am a bachelor in Novosibirsk State University. How can i get educational license for pycharm (study-purpose only, no commercial) success 0.496
Country_sanctions_allow_2 Can i change my country from France to Germany in my JB account? success 0.562
Country_sanctions_allow_3 I recently moved from Russia to Armenia. Am I eligible to use Jetbrains products now? success 0.662
Country_sanctions_allow_1 I study in Free University of Berlin, am I eligible for student license? success 0.539
Country_sanctions_block_4 I'm in Khabarovsk and for some reason I can't use Toolbox app success 0.624
Country_sanctions_block_3 I am trying to submit a ticket from Syria, and get some errors. Why? success 0.666
Country_sanctions_block_2 What is the way to tweak the settings so i can use Pycharm from Moscow? success 0.660
Country_sanctions_block_1 Can we buy an enterprise license for Junie for our organisation (based in Iran)? success 0.697
ij_docs_1 Can I see what test covers a particular line? success 0.826
ij_docs_2 Which testing frameworks does IntelliJ IDEA support? failure 0.743
ij_docs_3 What is a run configuration in IDEA? success 0.659
ij_docs_4 Which Gradle versions are supported in IntelliJ? Do I need to install them outside of IDEA? success 0.803
ij_docs_6 How does IntelliJ IDEA know which encoding does a file use success 0.897
ij_docs_7 Can I bring back uncommited changes that I accidentally deleted success 0.553
ij_docs_8 How do I install Vim plugin in IntelliJ IDEA? success 0.810
ij_docs_9 What I can and cannot automate using a macros in IntelliJ IDEA? success 0.764
ij_docs_10 What is language injection in IntelliJ IDEA? success 0.770
ij_docs_11 Does IntelliJ support .editorconfig? How do I use it? success 0.743
ij_docs_12 How do I remove tabs altogether from the editor in IntelliJ IDEA failure 0.470
QP_prod_relevant_14 If I buy the All Suite, How many AI credit I got ? failure 0.665
QP_prod_relevant_13 how do i switch the AI credits from the AI Pro Plan to the Ai credits that are part of my "all products pack" license? success 0.687
QP_prod_relevant_12 I need to disable and not reassign a company administrator success 0.571
QP_prod_relevant_11 I am a trial user for Rider with AI assistant. I am impressed and ready to go to a paid licenses. To determine which one I would like to know how many AI credit I used in the last 2 days since I started. success 0.629
ij_docs_13 How do I disable sticky lines? success 0.848
ij_docs_14 What are the main components of IntelliJ IDEA's editor? success 0.678
ij_docs_15 How do I make Bazel run a Gazelle target before sync success 0.741
ij_docs_16 What is the purpose of Bazel project views in IntelliJ IDEA success 0.829
ij_docs_17 Can I use database functionality in IntelliJ Community failure 0.564
ij_docs_17 How do I capture heap dump for a Java process in IntelliJ IDEA success 0.705
ij_docs_18 how do I monitor live resource usage for an external Java process in IntelliJ IDEA success 0.708
ij_docs_19 How do I 'git clone' in IntelliJ IDEA success 0.492
ij_docs_20 can I look into Java heap when debugging in IntelliJ IDEA? How do I find out number of instances for each class? success 0.849
ij_docs_21 what are prerequisites for debugging GraalVM in IntelliJ IDEA success 0.762
ij_docs_22 what are HotSwap limitations in IntelliJ IDEA? success 0.829
ij_docs_23 what does "step out" do in IntelliJ IDEA debugger success 0.717
QP_prod_relevant_10 is there a way to have a plugin just for specific projects? success 0.591
QP_prod_relevant_9 If I use a free for commercial use product, but then want to make my program for commercial purposes, then I buy a commercial license, is it fine? failure 0.757
QP_prod_relevant_8 "Hi, is it possible to see how many ai credits each developer uses?" failure 0.630
QP_prod_relevant_6 Hi, I have opened an account using my student email on your website and I'd like to apply for a student license. However, when I fill the application form, I get this error "If you would like to renew your Student License, please use the dedicated link in your JetBrains Account, or check the email reminder we send out one week before your license expires for the same link." I have tried to follow the link but it gets me back to my account which then directs me to the same form again. What should I do now? failure 0.633
QP_prod_relevant_5 i' m using ideal ultimate trial with my ai ultimate license, but junie stoped to work, ide and plugin is updated, ai plan is active, but no junie icon is show anymore, cant open the junie window failure 0.534
QP_prod_relevant_4 I'm looking for help to add my credit card to your site, so I can try the AI features for DataGrip. success 0.592
QP_prod_relevant_3 Hi, I want to change my VAT ID success 0.811
QP_prod_relevant_2 report on how credits are being used by each user. success 0.615
QP_prod_relevant_1 Hello, i'd like renew mi student license failure 0.685
Grazie_eval_adjusted_idea_9 How to use Emmet? success 0.661
Grazie_eval_adjusted_idea_8 How to change font size in idea? success 0.636
Grazie_eval_adjusted_idea_7 How to format code in idea? success 0.781
Grazie_eval_adjusted_idea_6 Which key combination makes several cursors? success 0.534
Grazie_eval_adjusted_idea_5 Which key combination renames an element? failure 0.480
Grazie_eval_adjusted_idea_4 Can I use VCS in safe mode? success 0.684
Grazie_eval_adjusted_idea_3 How to open presentation mode in idea? success 0.738
Grazie_eval_adjusted_idea_2 How to give more memory to IDE? success 0.600
Grazie_eval_adjusted_idea_10 Which icons are used for non-suspending breakpoints? success 0.531
Grazie_eval_adjusted_idea_1 How to open UML diagram for a class? success 0.711
Instruction_2_non_JB_question i want to program a flappy bird game, give me sample source code, link it to customer feed back form...For learning purposes failure 0.295
Instructions_1_vague_question I have a technical question success 0.325
KO_feedback_based_09 Hey, I have a recent MAC Sequoia 15.6 (24F74) and I can't manage to open the .dmg for datagrip success 0.694
KO_feedback_based_08 Hello, I have a problem getting a free subscription with my university email, it doesn't let me confirm the subscription failure 0.567
KO_feedback_based_07 I want to renew my student license, but I removed by accident link to renew my student pack. How I can renew? success 0.626
KO_feedback_based_06 my company is trying to buy me a datagrip licence. when i try to put in billing information it defaults to the UK, but my company is a US company success 0.582
KO_feedback_based_05 unfortunately I can't open Pycharm, it crashes before. my Mac is Intel and I've downloaded the 2025.2 version of Py charm failure 0.443
KO_feedback_based_04 unable to add card success 0.588
KO_feedback_based_03 i want to get a graduate discount success 0.592
KO_feedback_based_02 What IDes does Junie support success 0.659
KO_feedback_based_01 Hello, I get this error after my trial ended. I have subscribed to AI ultimate but get this error: You have reached you Ultimate Plan limit for this month. failure 0.518
Init_set_Webstorm_1_KnownBug I created a simple Angular project in Webstorm v20 with the CLI and included Karma tests. While running ng test works fine, I can't run a single or multiple tests in WebStorm. I get the following error in the runner: TypeError [ERR_INVALID_STATE]: Invalid state: Controller is already closed at ReadableStreamDefaultController.enqueue (node:internal/webstreams/readablestream:1077:13) at D:\Temp2025\ng20\node_modules@͏angular\build\src\builders\karma\application_builder.js:253:28 at Timeout.removeAllListeners [as _onTimeout] (D:\Temp2025\ng20\node_modules\karma\lib\server.js:468:9) at listOnTimeout (node:internal/timers:588:17) at process.processTimers (node:internal/timers:523:7) { code: 'ERR_INVALID_STATE' success 0.669
Init_set_Junie_1_install How to install Junie? success 0.680
Init_set_Webstorm_5_Debug The user complains that a debug session starts in a new blank instance of the browser. success 0.810
Init_set_Webstorm_4_freeze The user complains that the IDE freezes after start and he/she is unable to do anything. failure 0.570
Init_set_Webstorm_2_Performance My WebStorm operates slowly - completion, navigation success 0.504
Init_set_Webstorm_3_Tailwind The user says that Tailwind completion does not work failure 0.470
Init_set_Rider_2_dotNet Rider shows a lot of red code across the whole solution, .NET SDK symbols not resolved failure N/A