← Back to Overview

Run Results - Run 129

env: onprem-streaming | source: api

📊 Run Summary

Total Tests
88
Run Date
2026-05-06 13:39:01
Source
api
Bot Environment
onprem-streaming
Tags
-
✅ Success
27 (30%)
❌ Failure
61
🔗 Link Tests
27 (30%)
📝 Snippet Tests
87 (98%)
📈 RAGAS Overall
0.712 (71%, 88 samples)
Test Name Test Content Outcome Link Test Passed Snippet Test Passed RAGAS Overall Details
SB-977 What the heck are "AI credits", what are they used for and why happens if I ignore the "You ahve 0.0% of your Pro plan quote remaining." message? success ✅ ✅ 0.798
SB-916 I need information about the community version of pycharm success ✅ ✅ 0.747
SB-905 how do i update my datagrip version success ✅ ✅ 0.854
SB-8147 datagrip eats all my CPU failure ❌ ✅ 0.643
SB-752 Hi, I got this message from my AI Assistant Chat on IntelliJ Ides 2025.2 ## AI Assistant ou have reached the weekly fair use volume of JetBrains AI. If you need to allocate some extra volume, please contact our support team I would like to know what happened success ✅ ✅ 0.669
SB-741 Hi, I already have Jetbrains AI Pro purchased with my company But somehow it is stuck in Trial mode in my IntelliJ success ✅ ✅ 0.449
SB-7302 Any idea when the new JavaScript Temporal object will appear in YouTrack's ECMAScript implementation? success ✅ ✅ 0.760
SB-725 AI Chat with local models via Ollama is not working in Rider success ✅ ✅ 0.445
SB-6980 if i want to migrate the data from jira to youtrack in cloud purchanse will i be supported for data migration> failure ❌ ✅ 0.861
SB-6842 Hello, i need to fix authorization roles about my youtrack account. failure ❌ ✅ 0.719
SB-6781 When I change my ticket status to "Done" i receive an error that it is not "Ready to be pulled". what is that, please halp failure ❌ ✅ 0.845
SB-6058 nobleuplift@gmail.com YouTrack was deleted. I want to see if I cna restore it failure ❌ ✅ 0.623
SB-5802 We are experiencing a total outage on our YouTrack instance: https://rankmi.myjetbrains.com/. failure ❌ ✅ 0.551
SB-2221 i want to use pycharm on my laptop failure ❌ ✅ 0.785
SB-2244 I guess that the Junie AI Plugin is noct working properly but using my crcedits for not working. What can I do? failure ❌ ✅ 0.610
SB-2102 downloading pycharm failure ❌ ✅ 0.708
SB-2078 I would like to know if in MACOS pycharm can handle without needing a bridge connection a test environment for IOS apps failure ❌ ✅ 0.720
SB-2228 pycharm python console crashes if code.py exists failure ❌ ❌ 0.787
SB-2372 I installed Rider, ran our software (from one of our installers). I can attach, but breakpoints are disabled, with a message that the source file is not found among the loaded symbol documents to confuse things more: some colleagues can debug and break fine, some (like me) cannot break... We are running a net472 x64 application success ✅ ✅ 0.861
SB-3649 does data grip free version have a terminal ? failure ❌ ✅ 0.794
SB-3084 I add a new state type field in my helpdesk project. now almost full backlog is showing as unresolved. how can i fix it? I have deleted the fields but it didn't help failure ❌ ✅ 0.682
SB-2850 Hi, how can i activate ai assistant in my phpstorm failure ❌ ✅ 0.881
SB-2675 i have purchased an ai license but it doesnt activate in intellij failure ❌ ✅ 0.772
SB-2562 i cant seem to access the AI assistant pannel on the right side of my IntelliJ IDEA app failure ❌ ✅ 0.772
SB-2531 can i publish .net framework/wpf desktop applications using rider failure ❌ ✅ 0.758
SB-1846 hi i cant see on migration dialog in rider migratcions project ...i update .net do Version 10 and after this update i cant see migrations projcet failure ❌ ✅ 0.720
SB-1813 how do I know how much AI is remaining on my AI pro subscription? failure ❌ ✅ 0.841
SB-1801 I'd like to know more about AI credits. How to view my usage and remaining credits? failure ❌ ✅ 0.881
SB-1779 I'm having trouble logging into my student account on PyCharm Pro. I'm getting the following error: "Could not create an HTTP request handler to accept the authorization callback on any of these ports: 62,345-62,364. This can happen when the ports are used by other applications or there is another authorization process in progress." failure ❌ ✅ 0.679
SB-1770 Can you remove the expoired service API Pro ? It prevents me using Junie trial failure ❌ ✅ 0.681
SB-2054 my license for ai ultimate in intellij is not recognized failure ❌ ✅ 0.817
SB-1977 When creating a new project on PyCharm 2025.2, I cannot find the option "Playwright for Python" as showed in documentation failure ❌ ✅ 0.734
SB-1939 I have a All Products Pack license and installed PyCharm, now I want to activate PyCharm Pro but nothing happens failure ❌ ✅ 0.744
SB-1873 i want to start using AI assistent, was asked to add my creditcard, i did, and now It still asks for linkin my creditcard (using pycharm) failure ❌ ✅ 0.675
SB-1702 I have a company AI Pro Licence. since yesterday I got the message "Due to Abuse, we are temporary enabled card verifikation. No charges Apply. Thanks for your understanding. Link card to your jetbrains account". I cant do that, because its a Company Licence. failure ❌ ✅ 0.479
SB-1654 Running jupyter in Pycharm 2025.1.2 failure ❌ ✅ 0.723
SB-1648 does JetBrains AI Pro work with intelliJ community edition? failure ❌ ✅ 0.768
SB-1673 how do I use pycharm failure ❌ ✅ 0.766
SB-1639 I want to activate my trial for PyCharm, but I do not have the option to choose this subscription. failure ❌ ✅ 0.461
SB-1594 Is AI assistent free for student? success ✅ ✅ 0.793
SB-1591 I cannot activate AI assistant. It keeps saying the license has expired. BUt I have active license failure ❌ ✅ 0.829
SB-1488 How can I review AI usage? failure ❌ ✅ 0.449
SB-1401 I no longer get the functional commit modal in PyCharm failure ❌ ✅ 0.890
SB-1367 yesterday my PyCharm worked normally. now the application wont open on my macbook failure ❌ ✅ 0.639
SB-1342 I have a question about how variables are displayed in the PyCharm debugger success ✅ ✅ 0.570
SB-1338 which function arguments are possible in PyCharm Jupyter notebook failure ❌ ✅ 0.762
SB-1267 I have pycharm and it needs my jetbrains account and I'm new here success ✅ ✅ 0.667
SB-1179 Have I activated my AI Pro 30 day free trial yet? success ✅ ✅ 0.781
SB-1110 "I've been using PyCharm Community Edition for over 6 months and have completed 37 projects from the Udemy Python Bootcamp. Several projects started having errors with the import turtle statement (from turtle import Turtle, Screen). I'm on Ver 3.13. How do I upgrade to fix this without losing all of my work? success ✅ ✅ 0.695
SB-1021 I need help with activating Junie license. Company that I work for bought organization license for Junie. I have my personal PhpStorm license. How to activate Junie license? success ✅ ✅ 0.900
Country_sanctions_block_5 I am a bachelor in Novosibirsk State University. How can i get educational license for pycharm (study-purpose only, no commercial) success ✅ ✅ 0.481
Country_sanctions_allow_2 Can i change my country from France to Germany in my JB account? success ✅ ✅ 0.583
Country_sanctions_allow_3 I recently moved from Russia to Armenia. Am I eligible to use Jetbrains products now? success ✅ ✅ 0.641
Country_sanctions_allow_1 I study in Free University of Berlin, am I eligible for student license? success ✅ ✅ 0.564
Country_sanctions_block_4 I'm in Khabarovsk and for some reason I can't use Toolbox app success ✅ ✅ 0.606
Country_sanctions_block_3 I am trying to submit a ticket from Syria, and get some errors. Why? success ✅ ✅ 0.554
Country_sanctions_block_2 What is the way to tweak the settings so i can use Pycharm from Moscow? success ✅ ✅ 0.660
Country_sanctions_block_1 Can we buy an enterprise license for Junie for our organisation (based in Iran)? success ✅ ✅ 0.659
ij_docs_1 Can I see what test covers a particular line? failure ❌ ✅ 0.784
ij_docs_2 Which testing frameworks does IntelliJ IDEA support? failure ❌ ✅ 0.797
ij_docs_3 What is a run configuration in IDEA? failure ❌ ✅ 0.732
ij_docs_4 Which Gradle versions are supported in IntelliJ? Do I need to install them outside of IDEA? failure ❌ ✅ 0.796
ij_docs_6 How does IntelliJ IDEA know which encoding does a file use failure ❌ ✅ 0.882
ij_docs_7 Can I bring back uncommited changes that I accidentally deleted failure ❌ ✅ 0.550
ij_docs_8 How do I install Vim plugin in IntelliJ IDEA? failure ❌ ✅ 0.853
ij_docs_9 What I can and cannot automate using a macros in IntelliJ IDEA? failure ❌ ✅ 0.731
ij_docs_10 What is language injection in IntelliJ IDEA? failure ❌ ✅ 0.770
ij_docs_11 Does IntelliJ support .editorconfig? How do I use it? failure ❌ ✅ 0.772
ij_docs_12 How do I remove tabs altogether from the editor in IntelliJ IDEA failure ❌ ✅ 0.768
QP_prod_relevant_14 If I buy the All Suite, How many AI credit I got ? failure ❌ ✅ 0.650
QP_prod_relevant_13 how do i switch the AI credits from the AI Pro Plan to the Ai credits that are part of my "all products pack" license? failure ❌ ✅ 0.736
QP_prod_relevant_12 I need to disable and not reassign a company administrator failure ❌ ✅ 0.557
QP_prod_relevant_11 I am a trial user for Rider with AI assistant. I am impressed and ready to go to a paid licenses. To determine which one I would like to know how many AI credit I used in the last 2 days since I started. failure ❌ ✅ 0.582
ij_docs_13 How do I disable sticky lines? failure ❌ ✅ 0.734
ij_docs_14 What are the main components of IntelliJ IDEA's editor? failure ❌ ✅ 0.689
ij_docs_15 How do I make Bazel run a Gazelle target before sync failure ❌ ✅ 0.796
ij_docs_16 What is the purpose of Bazel project views in IntelliJ IDEA failure ❌ ✅ 0.903
ij_docs_17 Can I use database functionality in IntelliJ Community failure ❌ ✅ 0.549
ij_docs_17 How do I capture heap dump for a Java process in IntelliJ IDEA failure ❌ ✅ 0.664
ij_docs_18 how do I monitor live resource usage for an external Java process in IntelliJ IDEA failure ❌ ✅ 0.896
ij_docs_19 How do I 'git clone' in IntelliJ IDEA failure ❌ ✅ 0.491
ij_docs_20 can I look into Java heap when debugging in IntelliJ IDEA? How do I find out number of instances for each class? failure ❌ ✅ 0.892
ij_docs_21 what are prerequisites for debugging GraalVM in IntelliJ IDEA success ✅ ✅ 0.739
ij_docs_22 what are HotSwap limitations in IntelliJ IDEA? success ✅ ✅ 0.845
ij_docs_23 what does "step out" do in IntelliJ IDEA debugger success ✅ ✅ 0.778
QP_prod_relevant_10 is there a way to have a plugin just for specific projects? success ✅ ✅ 0.621
QP_prod_relevant_9 If I use a free for commercial use product, but then want to make my program for commercial purposes, then I buy a commercial license, is it fine? failure ❌ ✅ 0.757
QP_prod_relevant_8 "Hi, is it possible to see how many ai credits each developer uses?" success ✅ ✅ 0.550