← Back to Overview

Run Results - Run 157

env: rasa-bot-prod-9bf32dc9 | source: api

📊 Run Summary

Total Tests
125
Run Date
2026-08-13 11:03:00
Source
api
Bot Environment
rasa-bot-prod-9bf32dc9
Tags
-
✅ Success
106 (84%)
❌ Failure
19
🔗 Link Tests
107 (85%)
📝 Snippet Tests
124 (99%)
📈 RAGAS Overall
0.644 (64%, 125 samples)
Test Name Test Content Outcome Link Test Passed Snippet Test Passed RAGAS Overall Details
SB-977 What the heck are "AI credits", what are they used for and why happens if I ignore the "You ahve 0.0% of your Pro plan quote remaining." message? success 0.767
SB-916 I need information about the community version of pycharm success 0.684
SB-905 how do i update my datagrip version success 0.782
SB-8147 datagrip eats all my CPU success 0.691
SB-752 Hi, I got this message from my AI Assistant Chat on IntelliJ Ides 2025.2 ## AI Assistant ou have reached the weekly fair use volume of JetBrains AI. If you need to allocate some extra volume, please contact our support team I would like to know what happened success 0.459
SB-741 Hi, I already have Jetbrains AI Pro purchased with my company But somehow it is stuck in Trial mode in my IntelliJ success 0.670
SB-7302 Any idea when the new JavaScript Temporal object will appear in YouTrack's ECMAScript implementation? success 0.613
SB-725 AI Chat with local models via Ollama is not working in Rider success 0.449
SB-6980 if i want to migrate the data from jira to youtrack in cloud purchanse will i be supported for data migration> success 0.734
SB-6842 Hello, i need to fix authorization roles about my youtrack account. success 0.760
SB-6781 When I change my ticket status to "Done" i receive an error that it is not "Ready to be pulled". what is that, please halp success 0.648
SB-6058 nobleuplift@gmail.com YouTrack was deleted. I want to see if I cna restore it success 0.524
SB-5802 We are experiencing a total outage on our YouTrack instance: https://rankmi.myjetbrains.com/. success 0.781
SB-2221 i want to use pycharm on my laptop success 0.717
SB-2244 I guess that the Junie AI Plugin is noct working properly but using my crcedits for not working. What can I do? failure 0.335
SB-2102 downloading pycharm success 0.670
SB-2078 I would like to know if in MACOS pycharm can handle without needing a bridge connection a test environment for IOS apps success 0.718
SB-2228 pycharm python console crashes if code.py exists success 0.660
SB-2372 I installed Rider, ran our software (from one of our installers). I can attach, but breakpoints are disabled, with a message that the source file is not found among the loaded symbol documents to confuse things more: some colleagues can debug and break fine, some (like me) cannot break... We are running a net472 x64 application success 0.702
SB-3649 does data grip free version have a terminal ? success 0.758
SB-3084 I add a new state type field in my helpdesk project. now almost full backlog is showing as unresolved. how can i fix it? I have deleted the fields but it didn't help success 0.703
SB-2850 Hi, how can i activate ai assistant in my phpstorm success 0.723
SB-2675 i have purchased an ai license but it doesnt activate in intellij success 0.711
SB-2562 i cant seem to access the AI assistant pannel on the right side of my IntelliJ IDEA app success 0.605
SB-2531 can i publish .net framework/wpf desktop applications using rider success 0.836
SB-1846 hi i cant see on migration dialog in rider migratcions project ...i update .net do Version 10 and after this update i cant see migrations projcet success 0.760
SB-1813 how do I know how much AI is remaining on my AI pro subscription? success 0.766
SB-1801 I'd like to know more about AI credits. How to view my usage and remaining credits? success 0.873
SB-1779 I'm having trouble logging into my student account on PyCharm Pro. I'm getting the following error: "Could not create an HTTP request handler to accept the authorization callback on any of these ports: 62,345-62,364. This can happen when the ports are used by other applications or there is another authorization process in progress." success 0.704
SB-1770 Can you remove the expoired service API Pro ? It prevents me using Junie trial failure 0.708
SB-2054 my license for ai ultimate in intellij is not recognized success 0.687
SB-1977 When creating a new project on PyCharm 2025.2, I cannot find the option "Playwright for Python" as showed in documentation success 0.762
SB-1939 I have a All Products Pack license and installed PyCharm, now I want to activate PyCharm Pro but nothing happens success 0.716
SB-1873 i want to start using AI assistent, was asked to add my creditcard, i did, and now It still asks for linkin my creditcard (using pycharm) success 0.662
SB-1702 I have a company AI Pro Licence. since yesterday I got the message "Due to Abuse, we are temporary enabled card verifikation. No charges Apply. Thanks for your understanding. Link card to your jetbrains account". I cant do that, because its a Company Licence. success 0.591
SB-1654 Running jupyter in Pycharm 2025.1.2 success 0.760
SB-1648 does JetBrains AI Pro work with intelliJ community edition? success 0.654
SB-1673 how do I use pycharm success 0.646
SB-1639 I want to activate my trial for PyCharm, but I do not have the option to choose this subscription. success 0.579
SB-1594 Is AI assistent free for student? success 0.738
SB-1591 I cannot activate AI assistant. It keeps saying the license has expired. BUt I have active license success 0.691
SB-1488 How can I review AI usage? success 0.686
SB-1401 I no longer get the functional commit modal in PyCharm success 0.674
SB-1367 yesterday my PyCharm worked normally. now the application wont open on my macbook success 0.609
SB-1342 I have a question about how variables are displayed in the PyCharm debugger success 0.572
SB-1338 which function arguments are possible in PyCharm Jupyter notebook success 0.589
SB-1267 I have pycharm and it needs my jetbrains account and I'm new here success 0.739
SB-1179 Have I activated my AI Pro 30 day free trial yet? success 0.622
SB-1110 "I've been using PyCharm Community Edition for over 6 months and have completed 37 projects from the Udemy Python Bootcamp. Several projects started having errors with the import turtle statement (from turtle import Turtle, Screen). I'm on Ver 3.13. How do I upgrade to fix this without losing all of my work? success 0.631
SB-1021 I need help with activating Junie license. Company that I work for bought organization license for Junie. I have my personal PhpStorm license. How to activate Junie license? success 0.705
Country_sanctions_block_5 I am a bachelor in Novosibirsk State University. How can i get educational license for pycharm (study-purpose only, no commercial) success 0.581
Country_sanctions_allow_2 Can i change my country from France to Germany in my JB account? success 0.454
Country_sanctions_allow_3 I recently moved from Russia to Armenia. Am I eligible to use Jetbrains products now? success 0.627
Country_sanctions_allow_1 I study in Free University of Berlin, am I eligible for student license? success 0.500
Country_sanctions_block_4 I'm in Khabarovsk and for some reason I can't use Toolbox app success 0.431
Country_sanctions_block_3 I am trying to submit a ticket from Syria, and get some errors. Why? success 0.521
Country_sanctions_block_2 What is the way to tweak the settings so i can use Pycharm from Moscow? success 0.505
Country_sanctions_block_1 Can we buy an enterprise license for Junie for our organisation (based in Iran)? success 0.626
ij_docs_1 Can I see what test covers a particular line? success 0.728
ij_docs_2 Which testing frameworks does IntelliJ IDEA support? success 0.705
ij_docs_3 What is a run configuration in IDEA? success 0.809
ij_docs_4 Which Gradle versions are supported in IntelliJ? Do I need to install them outside of IDEA? success 0.596
ij_docs_6 How does IntelliJ IDEA know which encoding does a file use success 0.797
ij_docs_7 Can I bring back uncommited changes that I accidentally deleted failure 0.403
ij_docs_8 How do I install Vim plugin in IntelliJ IDEA? success 0.825
ij_docs_9 What I can and cannot automate using a macros in IntelliJ IDEA? success 0.810
ij_docs_10 What is language injection in IntelliJ IDEA? success 0.861
ij_docs_11 Does IntelliJ support .editorconfig? How do I use it? failure 0.674
ij_docs_12 How do I remove tabs altogether from the editor in IntelliJ IDEA failure 0.478
QP_prod_relevant_14 If I buy the All Suite, How many AI credit I got ? failure 0.748
QP_prod_relevant_13 how do i switch the AI credits from the AI Pro Plan to the Ai credits that are part of my "all products pack" license? success 0.718
QP_prod_relevant_12 I need to disable and not reassign a company administrator success 0.555
QP_prod_relevant_11 I am a trial user for Rider with AI assistant. I am impressed and ready to go to a paid licenses. To determine which one I would like to know how many AI credit I used in the last 2 days since I started. success 0.670
ij_docs_13 How do I disable sticky lines? success 0.860
ij_docs_14 What are the main components of IntelliJ IDEA's editor? success 0.651
ij_docs_15 How do I make Bazel run a Gazelle target before sync success 0.706
ij_docs_16 What is the purpose of Bazel project views in IntelliJ IDEA success 0.831
ij_docs_17 Can I use database functionality in IntelliJ Community success 0.659
ij_docs_17 How do I capture heap dump for a Java process in IntelliJ IDEA success 0.629
ij_docs_18 how do I monitor live resource usage for an external Java process in IntelliJ IDEA success 0.749
ij_docs_19 How do I 'git clone' in IntelliJ IDEA failure 0.835
ij_docs_20 can I look into Java heap when debugging in IntelliJ IDEA? How do I find out number of instances for each class? success 0.823
ij_docs_21 what are prerequisites for debugging GraalVM in IntelliJ IDEA success 0.614
ij_docs_22 what are HotSwap limitations in IntelliJ IDEA? success 0.793
ij_docs_23 what does "step out" do in IntelliJ IDEA debugger success 0.674
QP_prod_relevant_10 is there a way to have a plugin just for specific projects? success 0.706
QP_prod_relevant_9 If I use a free for commercial use product, but then want to make my program for commercial purposes, then I buy a commercial license, is it fine? failure 0.659
QP_prod_relevant_8 "Hi, is it possible to see how many ai credits each developer uses?" success 0.483
QP_prod_relevant_6 Hi, I have opened an account using my student email on your website and I'd like to apply for a student license. However, when I fill the application form, I get this error "If you would like to renew your Student License, please use the dedicated link in your JetBrains Account, or check the email reminder we send out one week before your license expires for the same link." I have tried to follow the link but it gets me back to my account which then directs me to the same form again. What should I do now? failure 0.644
QP_prod_relevant_5 i' m using ideal ultimate trial with my ai ultimate license, but junie stoped to work, ide and plugin is updated, ai plan is active, but no junie icon is show anymore, cant open the junie window success 0.654
QP_prod_relevant_4 I'm looking for help to add my credit card to your site, so I can try the AI features for DataGrip. success 0.550
QP_prod_relevant_3 Hi, I want to change my VAT ID success 0.440
QP_prod_relevant_2 report on how credits are being used by each user. success 0.601
QP_prod_relevant_1 Hello, i'd like renew mi student license success 0.618
Grazie_eval_adjusted_idea_9 How to use Emmet? failure 0.662
Grazie_eval_adjusted_idea_8 How to change font size in idea? success 0.727
Grazie_eval_adjusted_idea_7 How to format code in idea? success 0.703
Grazie_eval_adjusted_idea_6 Which key combination makes several cursors? success 0.514
Grazie_eval_adjusted_idea_5 Which key combination renames an element? failure 0.430
Grazie_eval_adjusted_idea_4 Can I use VCS in safe mode? success 0.560
Grazie_eval_adjusted_idea_3 How to open presentation mode in idea? success 0.757
Grazie_eval_adjusted_idea_2 How to give more memory to IDE? success 0.577
Grazie_eval_adjusted_idea_10 Which icons are used for non-suspending breakpoints? success 0.533
Grazie_eval_adjusted_idea_1 How to open UML diagram for a class? success 0.585
Instruction_2_non_JB_question i want to program a flappy bird game, give me sample source code, link it to customer feed back form...For learning purposes success 0.370
Instructions_1_vague_question I have a technical question success 0.200
KO_feedback_based_09 Hey, I have a recent MAC Sequoia 15.6 (24F74) and I can't manage to open the .dmg for datagrip success 0.620
KO_feedback_based_08 Hello, I have a problem getting a free subscription with my university email, it doesn't let me confirm the subscription failure 0.446
KO_feedback_based_07 I want to renew my student license, but I removed by accident link to renew my student pack. How I can renew? failure 0.570
KO_feedback_based_06 my company is trying to buy me a datagrip licence. when i try to put in billing information it defaults to the UK, but my company is a US company failure 0.556
KO_feedback_based_05 unfortunately I can't open Pycharm, it crashes before. my Mac is Intel and I've downloaded the 2025.2 version of Py charm failure 0.457
KO_feedback_based_04 unable to add card failure 0.549
KO_feedback_based_03 i want to get a graduate discount success 0.536
KO_feedback_based_02 What IDes does Junie support success 0.540
KO_feedback_based_01 Hello, I get this error after my trial ended. I have subscribed to AI ultimate but get this error: You have reached you Ultimate Plan limit for this month. failure 0.569
Init_set_Webstorm_1_KnownBug I created a simple Angular project in Webstorm v20 with the CLI and included Karma tests. While running ng test works fine, I can't run a single or multiple tests in WebStorm. I get the following error in the runner: TypeError [ERR_INVALID_STATE]: Invalid state: Controller is already closed at ReadableStreamDefaultController.enqueue (node:internal/webstreams/readablestream:1077:13) at D:\Temp2025\ng20\node_modules@͏angular\build\src\builders\karma\application_builder.js:253:28 at Timeout.removeAllListeners [as _onTimeout] (D:\Temp2025\ng20\node_modules\karma\lib\server.js:468:9) at listOnTimeout (node:internal/timers:588:17) at process.processTimers (node:internal/timers:523:7) { code: 'ERR_INVALID_STATE' success 0.627
Init_set_Junie_1_install How to install Junie? success 0.644
Init_set_Webstorm_5_Debug The user complains that a debug session starts in a new blank instance of the browser. success 0.652
Init_set_Webstorm_4_freeze The user complains that the IDE freezes after start and he/she is unable to do anything. failure 0.819
Init_set_Webstorm_2_Performance My WebStorm operates slowly - completion, navigation success 0.397
Init_set_Webstorm_3_Tailwind The user says that Tailwind completion does not work success 0.775
Init_set_Rider_4_ETW JetBrains ETW service is not uninstalled together with Rider success 0.725
Init_set_Rider_3_crash_I9 Rider crashes after opening a project in an Intel i9 CPU success 0.646
Init_set_Rider_2_dotNet Rider shows a lot of red code across the whole solution, .NET SDK symbols not resolved success 0.619
Init_set_Rider_1_Formatting How to share formatting settings with the whole team? failure 0.536