โ† Back to Overview

Run Results - Run 139

env: onprem-streaming | source: api

๐Ÿ“Š Run Summary

Total Tests
125
Run Date
2026-06-10 21:01:50
Source
api
Bot Environment
onprem-streaming
Tags
-
โœ… Success
18 (14%)
โŒ Failure
107
๐Ÿ”— Link Tests
108 (86%)
๐Ÿ“ Snippet Tests
21 (16%)
๐Ÿ“ˆ RAGAS Overall
0.686 (69%, 125 samples)
Test Name Test Content Outcome Link Test Passed Snippet Test Passed RAGAS Overall Details
Name content success โœ… โœ… 0.122
SB-977 What the heck are "AI credits", what are they used for and why happens if I ignore the "You ahve 0.0% of your Pro plan quote remaining." message? failure โœ… โŒ 0.882
SB-916 I need information about the community version of pycharm failure โœ… โŒ 0.744
SB-905 how do i update my datagrip version failure โœ… โŒ 0.746
SB-8147 datagrip eats all my CPU failure โœ… โŒ 0.633
SB-752 Hi, I got this message from my AI Assistant Chat on IntelliJ Ides 2025.2 ## AI Assistant ou have reached the weekly fair use volume of JetBrains AI. If you need to allocate some extra volume, please contact our support team I would like to know what happened failure โœ… โŒ 0.726
SB-741 Hi, I already have Jetbrains AI Pro purchased with my company But somehow it is stuck in Trial mode in my IntelliJ failure โœ… โŒ 0.411
SB-7302 Any idea when the new JavaScript Temporal object will appear in YouTrack's ECMAScript implementation? failure โœ… โŒ 0.707
SB-725 AI Chat with local models via Ollama is not working in Rider failure โœ… โŒ 0.429
SB-6980 if i want to migrate the data from jira to youtrack in cloud purchanse will i be supported for data migration> failure โœ… โŒ 0.858
SB-6842 Hello, i need to fix authorization roles about my youtrack account. failure โœ… โŒ 0.774
SB-6781 When I change my ticket status to "Done" i receive an error that it is not "Ready to be pulled". what is that, please halp failure โœ… โŒ 0.846
SB-6058 nobleuplift@gmail.com YouTrack was deleted. I want to see if I cna restore it failure โœ… โŒ 0.638
SB-5802 We are experiencing a total outage on our YouTrack instance: https://rankmi.myjetbrains.com/. failure โœ… โŒ 0.620
SB-2221 i want to use pycharm on my laptop failure โœ… โŒ 0.747
SB-2244 I guess that the Junie AI Plugin is noct working properly but using my crcedits for not working. What can I do? failure โœ… โŒ 0.530
SB-2102 downloading pycharm failure โœ… โŒ 0.809
SB-2078 I would like to know if in MACOS pycharm can handle without needing a bridge connection a test environment for IOS apps failure โœ… โŒ 0.810
SB-2228 pycharm python console crashes if code.py exists failure โœ… โŒ 0.806
SB-2372 I installed Rider, ran our software (from one of our installers). I can attach, but breakpoints are disabled, with a message that the source file is not found among the loaded symbol documents to confuse things more: some colleagues can debug and break fine, some (like me) cannot break... We are running a net472 x64 application failure โœ… โŒ 0.861
SB-3649 does data grip free version have a terminal ? failure โœ… โŒ 0.891
SB-3084 I add a new state type field in my helpdesk project. now almost full backlog is showing as unresolved. how can i fix it? I have deleted the fields but it didn't help failure โœ… โŒ 0.703
SB-2850 Hi, how can i activate ai assistant in my phpstorm failure โœ… โŒ 0.813
SB-2675 i have purchased an ai license but it doesnt activate in intellij failure โœ… โŒ 0.725
SB-2562 i cant seem to access the AI assistant pannel on the right side of my IntelliJ IDEA app failure โœ… โŒ 0.810
SB-2531 can i publish .net framework/wpf desktop applications using rider failure โœ… โŒ 0.810
SB-1846 hi i cant see on migration dialog in rider migratcions project ...i update .net do Version 10 and after this update i cant see migrations projcet failure โœ… โŒ 0.734
SB-1813 how do I know how much AI is remaining on my AI pro subscription? failure โœ… โŒ 0.754
SB-1801 I'd like to know more about AI credits. How to view my usage and remaining credits? failure โœ… โŒ 0.864
SB-1779 I'm having trouble logging into my student account on PyCharm Pro. I'm getting the following error: "Could not create an HTTP request handler to accept the authorization callback on any of these ports: 62,345-62,364. This can happen when the ports are used by other applications or there is another authorization process in progress." failure โœ… โŒ 0.662
SB-1770 Can you remove the expoired service API Pro ? It prevents me using Junie trial failure โœ… โŒ 0.714
SB-2054 my license for ai ultimate in intellij is not recognized failure โœ… โŒ 0.789
SB-1977 When creating a new project on PyCharm 2025.2, I cannot find the option "Playwright for Python" as showed in documentation failure โœ… โŒ 0.737
SB-1939 I have a All Products Pack license and installed PyCharm, now I want to activate PyCharm Pro but nothing happens failure โœ… โŒ 0.802
SB-1873 i want to start using AI assistent, was asked to add my creditcard, i did, and now It still asks for linkin my creditcard (using pycharm) failure โœ… โŒ 0.733
SB-1702 I have a company AI Pro Licence. since yesterday I got the message "Due to Abuse, we are temporary enabled card verifikation. No charges Apply. Thanks for your understanding. Link card to your jetbrains account". I cant do that, because its a Company Licence. failure โŒ โŒ 0.615
SB-1654 Running jupyter in Pycharm 2025.1.2 failure โœ… โŒ 0.709
SB-1648 does JetBrains AI Pro work with intelliJ community edition? failure โœ… โŒ 0.684
SB-1673 how do I use pycharm failure โœ… โŒ 0.805
SB-1639 I want to activate my trial for PyCharm, but I do not have the option to choose this subscription. failure โœ… โŒ 0.604
SB-1594 Is AI assistent free for student? failure โœ… โŒ 0.745
SB-1591 I cannot activate AI assistant. It keeps saying the license has expired. BUt I have active license failure โœ… โŒ 0.822
SB-1488 How can I review AI usage? failure โœ… โŒ 0.762
SB-1401 I no longer get the functional commit modal in PyCharm failure โœ… โŒ 0.844
SB-1367 yesterday my PyCharm worked normally. now the application wont open on my macbook failure โœ… โŒ 0.586
SB-1342 I have a question about how variables are displayed in the PyCharm debugger failure โœ… โŒ 0.585
SB-1338 which function arguments are possible in PyCharm Jupyter notebook failure โœ… โŒ 0.841
SB-1267 I have pycharm and it needs my jetbrains account and I'm new here failure โœ… โŒ 0.688
SB-1179 Have I activated my AI Pro 30 day free trial yet? failure โœ… โŒ 0.898
SB-1110 "I've been using PyCharm Community Edition for over 6 months and have completed 37 projects from the Udemy Python Bootcamp. Several projects started having errors with the import turtle statement (from turtle import Turtle, Screen). I'm on Ver 3.13. How do I upgrade to fix this without losing all of my work? failure โœ… โŒ 0.791
SB-1021 I need help with activating Junie license. Company that I work for bought organization license for Junie. I have my personal PhpStorm license. How to activate Junie license? failure โœ… โŒ 0.683
Country_sanctions_block_5 I am a bachelor in Novosibirsk State University. How can i get educational license for pycharm (study-purpose only, no commercial) failure โœ… โŒ 0.620
Country_sanctions_allow_2 Can i change my country from France to Germany in my JB account? failure โœ… โŒ 0.719
Country_sanctions_allow_3 I recently moved from Russia to Armenia. Am I eligible to use Jetbrains products now? failure โœ… โŒ 0.678
Country_sanctions_allow_1 I study in Free University of Berlin, am I eligible for student license? failure โœ… โŒ 0.521
Country_sanctions_block_4 I'm in Khabarovsk and for some reason I can't use Toolbox app failure โœ… โŒ 0.606
Country_sanctions_block_3 I am trying to submit a ticket from Syria, and get some errors. Why? failure โœ… โŒ 0.555
Country_sanctions_block_2 What is the way to tweak the settings so i can use Pycharm from Moscow? failure โœ… โŒ 0.660
Country_sanctions_block_1 Can we buy an enterprise license for Junie for our organisation (based in Iran)? failure โœ… โŒ 0.644
ij_docs_1 Can I see what test covers a particular line? failure โœ… โŒ 0.643
ij_docs_2 Which testing frameworks does IntelliJ IDEA support? failure โŒ โŒ 0.829
ij_docs_3 What is a run configuration in IDEA? failure โœ… โŒ 0.745
ij_docs_4 Which Gradle versions are supported in IntelliJ? Do I need to install them outside of IDEA? failure โœ… โŒ 0.729
ij_docs_6 How does IntelliJ IDEA know which encoding does a file use failure โœ… โŒ 0.887
ij_docs_7 Can I bring back uncommited changes that I accidentally deleted failure โœ… โŒ 0.513
ij_docs_8 How do I install Vim plugin in IntelliJ IDEA? failure โœ… โŒ 0.790
ij_docs_9 What I can and cannot automate using a macros in IntelliJ IDEA? failure โœ… โŒ 0.769
ij_docs_10 What is language injection in IntelliJ IDEA? failure โœ… โŒ 0.782
ij_docs_11 Does IntelliJ support .editorconfig? How do I use it? failure โœ… โŒ 0.711
ij_docs_12 How do I remove tabs altogether from the editor in IntelliJ IDEA failure โŒ โŒ 0.710
QP_prod_relevant_14 If I buy the All Suite, How many AI credit I got ? failure โŒ โŒ 0.847
QP_prod_relevant_13 how do i switch the AI credits from the AI Pro Plan to the Ai credits that are part of my "all products pack" license? success โœ… โœ… 0.705
QP_prod_relevant_12 I need to disable and not reassign a company administrator success โœ… โœ… 0.512
QP_prod_relevant_11 I am a trial user for Rider with AI assistant. I am impressed and ready to go to a paid licenses. To determine which one I would like to know how many AI credit I used in the last 2 days since I started. failure โœ… โŒ 0.725
ij_docs_13 How do I disable sticky lines? failure โŒ โŒ 0.848
ij_docs_14 What are the main components of IntelliJ IDEA's editor? failure โœ… โŒ 0.657
ij_docs_15 How do I make Bazel run a Gazelle target before sync failure โœ… โŒ 0.732
ij_docs_16 What is the purpose of Bazel project views in IntelliJ IDEA failure โœ… โŒ 0.907
ij_docs_17 Can I use database functionality in IntelliJ Community failure โœ… โŒ 0.620
ij_docs_17 How do I capture heap dump for a Java process in IntelliJ IDEA failure โœ… โŒ 0.600
ij_docs_18 how do I monitor live resource usage for an external Java process in IntelliJ IDEA failure โœ… โŒ 0.875
ij_docs_19 How do I 'git clone' in IntelliJ IDEA failure โœ… โŒ 0.866
ij_docs_20 can I look into Java heap when debugging in IntelliJ IDEA? How do I find out number of instances for each class? failure โœ… โŒ 0.751
ij_docs_21 what are prerequisites for debugging GraalVM in IntelliJ IDEA failure โœ… โŒ 0.692
ij_docs_22 what are HotSwap limitations in IntelliJ IDEA? failure โœ… โŒ 0.746
ij_docs_23 what does "step out" do in IntelliJ IDEA debugger failure โœ… โŒ 0.713
QP_prod_relevant_10 is there a way to have a plugin just for specific projects? failure โœ… โŒ 0.545
QP_prod_relevant_9 If I use a free for commercial use product, but then want to make my program for commercial purposes, then I buy a commercial license, is it fine? failure โŒ โŒ 0.676
QP_prod_relevant_8 "Hi, is it possible to see how many ai credits each developer uses?" failure โŒ โŒ 0.494
QP_prod_relevant_6 Hi, I have opened an account using my student email on your website and I'd like to apply for a student license. However, when I fill the application form, I get this error "If you would like to renew your Student License, please use the dedicated link in your JetBrains Account, or check the email reminder we send out one week before your license expires for the same link." I have tried to follow the link but it gets me back to my account which then directs me to the same form again. What should I do now? failure โŒ โŒ 0.570
QP_prod_relevant_5 i' m using ideal ultimate trial with my ai ultimate license, but junie stoped to work, ide and plugin is updated, ai plan is active, but no junie icon is show anymore, cant open the junie window failure โœ… โŒ 0.546
QP_prod_relevant_4 I'm looking for help to add my credit card to your site, so I can try the AI features for DataGrip. failure โœ… โŒ 0.617
QP_prod_relevant_3 Hi, I want to change my VAT ID failure โœ… โŒ 0.833
QP_prod_relevant_2 report on how credits are being used by each user. failure โŒ โŒ 0.478
QP_prod_relevant_1 Hello, i'd like renew mi student license failure โœ… โŒ 0.708
Grazie_eval_adjusted_idea_9 How to use Emmet? success โœ… โœ… 0.662
Grazie_eval_adjusted_idea_8 How to change font size in idea? failure โœ… โŒ 0.688
Grazie_eval_adjusted_idea_7 How to format code in idea? success โœ… โœ… 0.709
Grazie_eval_adjusted_idea_6 Which key combination makes several cursors? success โœ… โœ… 0.600
Grazie_eval_adjusted_idea_5 Which key combination renames an element? failure โŒ โŒ 0.486
Grazie_eval_adjusted_idea_4 Can I use VCS in safe mode? success โœ… โœ… 0.617
Grazie_eval_adjusted_idea_3 How to open presentation mode in idea? success โœ… โœ… 0.735
Grazie_eval_adjusted_idea_2 How to give more memory to IDE? success โœ… โœ… 0.552
Grazie_eval_adjusted_idea_10 Which icons are used for non-suspending breakpoints? failure โœ… โŒ 0.530
Grazie_eval_adjusted_idea_1 How to open UML diagram for a class? failure โœ… โŒ 0.669
Instruction_2_non_JB_question i want to program a flappy bird game, give me sample source code, link it to customer feed back form...For learning purposes failure โœ… โŒ 0.319
Instructions_1_vague_question I have a technical question failure โœ… โŒ 0.288
KO_feedback_based_09 Hey, I have a recent MAC Sequoia 15.6 (24F74) and I can't manage to open the .dmg for datagrip success โœ… โœ… 0.745
KO_feedback_based_08 Hello, I have a problem getting a free subscription with my university email, it doesn't let me confirm the subscription failure โŒ โœ… 0.535
KO_feedback_based_07 I want to renew my student license, but I removed by accident link to renew my student pack. How I can renew? failure โŒ โœ… 0.637
KO_feedback_based_06 my company is trying to buy me a datagrip licence. when i try to put in billing information it defaults to the UK, but my company is a US company failure โŒ โœ… 0.596
KO_feedback_based_05 unfortunately I can't open Pycharm, it crashes before. my Mac is Intel and I've downloaded the 2025.2 version of Py charm failure โŒ โŒ 0.432
KO_feedback_based_04 unable to add card success โœ… โœ… 0.600
KO_feedback_based_03 i want to get a graduate discount success โœ… โœ… 0.579
KO_feedback_based_02 What IDes does Junie support success โœ… โœ… 0.576
KO_feedback_based_01 Hello, I get this error after my trial ended. I have subscribed to AI ultimate but get this error: You have reached you Ultimate Plan limit for this month. failure โŒ โŒ 0.613
Init_set_Webstorm_1_KnownBug I created a simple Angular project in Webstorm v20 with the CLI and included Karma tests. While running ng test works fine, I can't run a single or multiple tests in WebStorm. I get the following error in the runner: TypeError [ERR_INVALID_STATE]: Invalid state: Controller is already closed at ReadableStreamDefaultController.enqueue (node:internal/webstreams/readablestream:1077:13) at D:\Temp2025\ng20\node_modules@อangular\build\src\builders\karma\application_builder.js:253:28 at Timeout.removeAllListeners [as _onTimeout] (D:\Temp2025\ng20\node_modules\karma\lib\server.js:468:9) at listOnTimeout (node:internal/timers:588:17) at process.processTimers (node:internal/timers:523:7) { code: 'ERR_INVALID_STATE' success โœ… โœ… 0.629
Init_set_Junie_1_install How to install Junie? success โœ… โœ… 0.679
Init_set_Webstorm_5_Debug The user complains that a debug session starts in a new blank instance of the browser. failure โœ… โŒ 0.740
Init_set_Webstorm_4_freeze The user complains that the IDE freezes after start and he/she is unable to do anything. failure โŒ โŒ 0.792
Init_set_Webstorm_2_Performance My WebStorm operates slowly - completion, navigation failure โœ… โŒ 0.605
Init_set_Webstorm_3_Tailwind The user says that Tailwind completion does not work failure โŒ โŒ 0.791
Init_set_Rider_4_ETW JetBrains ETW service is not uninstalled together with Rider success โœ… โœ… 0.781
Init_set_Rider_3_crash_I9 Rider crashes after opening a project in an Intel i9 CPU success โœ… โœ… 0.740
Init_set_Rider_2_dotNet Rider shows a lot of red code across the whole solution, .NET SDK symbols not resolved success โœ… โœ… 0.563