← Back to Overview

Run Results - Run 148

env: rasa-bot-4-9bf32dc9 | source: api

📊 Run Summary

Total Tests
125
Run Date
2026-06-22 11:58:39
Source
api
Bot Environment
rasa-bot-4-9bf32dc9
Tags
-
✅ Success
105 (84%)
❌ Failure
20
🔗 Link Tests
107 (85%)
📝 Snippet Tests
123 (98%)
📈 RAGAS Overall
0.637 (64%, 125 samples)
Test Name Test Content Outcome Link Test Passed Snippet Test Passed RAGAS Overall Details
SB-977 What the heck are "AI credits", what are they used for and why happens if I ignore the "You ahve 0.0% of your Pro plan quote remaining." message? success 0.733
SB-916 I need information about the community version of pycharm success 0.672
SB-905 how do i update my datagrip version success 0.747
SB-8147 datagrip eats all my CPU success 0.575
SB-752 Hi, I got this message from my AI Assistant Chat on IntelliJ Ides 2025.2 ## AI Assistant ou have reached the weekly fair use volume of JetBrains AI. If you need to allocate some extra volume, please contact our support team I would like to know what happened success 0.487
SB-741 Hi, I already have Jetbrains AI Pro purchased with my company But somehow it is stuck in Trial mode in my IntelliJ success 0.728
SB-7302 Any idea when the new JavaScript Temporal object will appear in YouTrack's ECMAScript implementation? success 0.778
SB-725 AI Chat with local models via Ollama is not working in Rider success 0.441
SB-6980 if i want to migrate the data from jira to youtrack in cloud purchanse will i be supported for data migration> success 0.812
SB-6842 Hello, i need to fix authorization roles about my youtrack account. success 0.663
SB-6781 When I change my ticket status to "Done" i receive an error that it is not "Ready to be pulled". what is that, please halp success 0.752
SB-6058 nobleuplift@gmail.com YouTrack was deleted. I want to see if I cna restore it success 0.632
SB-5802 We are experiencing a total outage on our YouTrack instance: https://rankmi.myjetbrains.com/. success 0.628
SB-2221 i want to use pycharm on my laptop success 0.761
SB-2244 I guess that the Junie AI Plugin is noct working properly but using my crcedits for not working. What can I do? success 0.465
SB-2102 downloading pycharm success 0.700
SB-2078 I would like to know if in MACOS pycharm can handle without needing a bridge connection a test environment for IOS apps success 0.773
SB-2228 pycharm python console crashes if code.py exists success 0.814
SB-2372 I installed Rider, ran our software (from one of our installers). I can attach, but breakpoints are disabled, with a message that the source file is not found among the loaded symbol documents to confuse things more: some colleagues can debug and break fine, some (like me) cannot break... We are running a net472 x64 application success 0.646
SB-3649 does data grip free version have a terminal ? success 0.716
SB-3084 I add a new state type field in my helpdesk project. now almost full backlog is showing as unresolved. how can i fix it? I have deleted the fields but it didn't help success 0.716
SB-2850 Hi, how can i activate ai assistant in my phpstorm success 0.720
SB-2675 i have purchased an ai license but it doesnt activate in intellij success 0.662
SB-2562 i cant seem to access the AI assistant pannel on the right side of my IntelliJ IDEA app success 0.624
SB-2531 can i publish .net framework/wpf desktop applications using rider success 0.775
SB-1846 hi i cant see on migration dialog in rider migratcions project ...i update .net do Version 10 and after this update i cant see migrations projcet success 0.765
SB-1813 how do I know how much AI is remaining on my AI pro subscription? success 0.772
SB-1801 I'd like to know more about AI credits. How to view my usage and remaining credits? success 0.865
SB-1779 I'm having trouble logging into my student account on PyCharm Pro. I'm getting the following error: "Could not create an HTTP request handler to accept the authorization callback on any of these ports: 62,345-62,364. This can happen when the ports are used by other applications or there is another authorization process in progress." success 0.790
SB-1770 Can you remove the expoired service API Pro ? It prevents me using Junie trial failure 0.586
SB-2054 my license for ai ultimate in intellij is not recognized success 0.674
SB-1977 When creating a new project on PyCharm 2025.2, I cannot find the option "Playwright for Python" as showed in documentation success 0.733
SB-1939 I have a All Products Pack license and installed PyCharm, now I want to activate PyCharm Pro but nothing happens success 0.660
SB-1873 i want to start using AI assistent, was asked to add my creditcard, i did, and now It still asks for linkin my creditcard (using pycharm) success 0.633
SB-1702 I have a company AI Pro Licence. since yesterday I got the message "Due to Abuse, we are temporary enabled card verifikation. No charges Apply. Thanks for your understanding. Link card to your jetbrains account". I cant do that, because its a Company Licence. success 0.600
SB-1654 Running jupyter in Pycharm 2025.1.2 success 0.540
SB-1648 does JetBrains AI Pro work with intelliJ community edition? success 0.709
SB-1673 how do I use pycharm success 0.714
SB-1639 I want to activate my trial for PyCharm, but I do not have the option to choose this subscription. success 0.692
SB-1594 Is AI assistent free for student? success 0.693
SB-1591 I cannot activate AI assistant. It keeps saying the license has expired. BUt I have active license success 0.684
SB-1488 How can I review AI usage? success 0.705
SB-1401 I no longer get the functional commit modal in PyCharm success 0.746
SB-1367 yesterday my PyCharm worked normally. now the application wont open on my macbook failure 0.356
SB-1342 I have a question about how variables are displayed in the PyCharm debugger success 0.693
SB-1338 which function arguments are possible in PyCharm Jupyter notebook success 0.568
SB-1267 I have pycharm and it needs my jetbrains account and I'm new here success 0.690
SB-1179 Have I activated my AI Pro 30 day free trial yet? success 0.839
SB-1110 "I've been using PyCharm Community Edition for over 6 months and have completed 37 projects from the Udemy Python Bootcamp. Several projects started having errors with the import turtle statement (from turtle import Turtle, Screen). I'm on Ver 3.13. How do I upgrade to fix this without losing all of my work? success 0.617
SB-1021 I need help with activating Junie license. Company that I work for bought organization license for Junie. I have my personal PhpStorm license. How to activate Junie license? success 0.755
Country_sanctions_block_5 I am a bachelor in Novosibirsk State University. How can i get educational license for pycharm (study-purpose only, no commercial) success 0.510
Country_sanctions_allow_2 Can i change my country from France to Germany in my JB account? success 0.570
Country_sanctions_allow_3 I recently moved from Russia to Armenia. Am I eligible to use Jetbrains products now? success 0.602
Country_sanctions_allow_1 I study in Free University of Berlin, am I eligible for student license? success 0.602
Country_sanctions_block_4 I'm in Khabarovsk and for some reason I can't use Toolbox app success 0.560
Country_sanctions_block_3 I am trying to submit a ticket from Syria, and get some errors. Why? success 0.684
Country_sanctions_block_2 What is the way to tweak the settings so i can use Pycharm from Moscow? success 0.458
Country_sanctions_block_1 Can we buy an enterprise license for Junie for our organisation (based in Iran)? success 0.481
ij_docs_1 Can I see what test covers a particular line? success 0.622
ij_docs_2 Which testing frameworks does IntelliJ IDEA support? success 0.782
ij_docs_3 What is a run configuration in IDEA? success 0.843
ij_docs_4 Which Gradle versions are supported in IntelliJ? Do I need to install them outside of IDEA? success 0.621
ij_docs_6 How does IntelliJ IDEA know which encoding does a file use success 0.814
ij_docs_7 Can I bring back uncommited changes that I accidentally deleted success 0.413
ij_docs_8 How do I install Vim plugin in IntelliJ IDEA? success 0.700
ij_docs_9 What I can and cannot automate using a macros in IntelliJ IDEA? success 0.630
ij_docs_10 What is language injection in IntelliJ IDEA? success 0.836
ij_docs_11 Does IntelliJ support .editorconfig? How do I use it? success 0.696
ij_docs_12 How do I remove tabs altogether from the editor in IntelliJ IDEA failure 0.474
QP_prod_relevant_14 If I buy the All Suite, How many AI credit I got ? failure 0.579
QP_prod_relevant_13 how do i switch the AI credits from the AI Pro Plan to the Ai credits that are part of my "all products pack" license? success 0.727
QP_prod_relevant_12 I need to disable and not reassign a company administrator success 0.518
QP_prod_relevant_11 I am a trial user for Rider with AI assistant. I am impressed and ready to go to a paid licenses. To determine which one I would like to know how many AI credit I used in the last 2 days since I started. success 0.624
ij_docs_13 How do I disable sticky lines? failure 0.812
ij_docs_14 What are the main components of IntelliJ IDEA's editor? success 0.646
ij_docs_15 How do I make Bazel run a Gazelle target before sync success 0.621
ij_docs_16 What is the purpose of Bazel project views in IntelliJ IDEA success 0.857
ij_docs_17 Can I use database functionality in IntelliJ Community success 0.588
ij_docs_17 How do I capture heap dump for a Java process in IntelliJ IDEA success 0.611
ij_docs_18 how do I monitor live resource usage for an external Java process in IntelliJ IDEA success 0.834
ij_docs_19 How do I 'git clone' in IntelliJ IDEA success 0.482
ij_docs_20 can I look into Java heap when debugging in IntelliJ IDEA? How do I find out number of instances for each class? success 0.761
ij_docs_21 what are prerequisites for debugging GraalVM in IntelliJ IDEA success 0.692
ij_docs_22 what are HotSwap limitations in IntelliJ IDEA? success 0.850
ij_docs_23 what does "step out" do in IntelliJ IDEA debugger success 0.712
QP_prod_relevant_10 is there a way to have a plugin just for specific projects? success 0.560
QP_prod_relevant_9 If I use a free for commercial use product, but then want to make my program for commercial purposes, then I buy a commercial license, is it fine? failure 0.749
QP_prod_relevant_8 "Hi, is it possible to see how many ai credits each developer uses?" failure 0.445
QP_prod_relevant_6 Hi, I have opened an account using my student email on your website and I'd like to apply for a student license. However, when I fill the application form, I get this error "If you would like to renew your Student License, please use the dedicated link in your JetBrains Account, or check the email reminder we send out one week before your license expires for the same link." I have tried to follow the link but it gets me back to my account which then directs me to the same form again. What should I do now? failure 0.636
QP_prod_relevant_5 i' m using ideal ultimate trial with my ai ultimate license, but junie stoped to work, ide and plugin is updated, ai plan is active, but no junie icon is show anymore, cant open the junie window failure 0.458
QP_prod_relevant_4 I'm looking for help to add my credit card to your site, so I can try the AI features for DataGrip. success 0.679
QP_prod_relevant_3 Hi, I want to change my VAT ID success 0.500
QP_prod_relevant_2 report on how credits are being used by each user. success 0.463
QP_prod_relevant_1 Hello, i'd like renew mi student license success 0.618
Grazie_eval_adjusted_idea_9 How to use Emmet? failure 0.648
Grazie_eval_adjusted_idea_8 How to change font size in idea? success 0.690
Grazie_eval_adjusted_idea_7 How to format code in idea? success 0.697
Grazie_eval_adjusted_idea_6 Which key combination makes several cursors? success 0.521
Grazie_eval_adjusted_idea_5 Which key combination renames an element? failure 0.448
Grazie_eval_adjusted_idea_4 Can I use VCS in safe mode? success 0.551
Grazie_eval_adjusted_idea_3 How to open presentation mode in idea? success 0.783
Grazie_eval_adjusted_idea_2 How to give more memory to IDE? success 0.604
Grazie_eval_adjusted_idea_10 Which icons are used for non-suspending breakpoints? failure 0.500
Grazie_eval_adjusted_idea_1 How to open UML diagram for a class? success 0.588
Instruction_2_non_JB_question i want to program a flappy bird game, give me sample source code, link it to customer feed back form...For learning purposes success 0.296
Instructions_1_vague_question I have a technical question success 0.206
KO_feedback_based_09 Hey, I have a recent MAC Sequoia 15.6 (24F74) and I can't manage to open the .dmg for datagrip success 0.653
KO_feedback_based_08 Hello, I have a problem getting a free subscription with my university email, it doesn't let me confirm the subscription failure 0.471
KO_feedback_based_07 I want to renew my student license, but I removed by accident link to renew my student pack. How I can renew? failure 0.566
KO_feedback_based_06 my company is trying to buy me a datagrip licence. when i try to put in billing information it defaults to the UK, but my company is a US company success 0.532
KO_feedback_based_05 unfortunately I can't open Pycharm, it crashes before. my Mac is Intel and I've downloaded the 2025.2 version of Py charm failure 0.461
KO_feedback_based_04 unable to add card failure 0.489
KO_feedback_based_03 i want to get a graduate discount success 0.573
KO_feedback_based_02 What IDes does Junie support success 0.595
KO_feedback_based_01 Hello, I get this error after my trial ended. I have subscribed to AI ultimate but get this error: You have reached you Ultimate Plan limit for this month. failure 0.609
Init_set_Webstorm_1_KnownBug I created a simple Angular project in Webstorm v20 with the CLI and included Karma tests. While running ng test works fine, I can't run a single or multiple tests in WebStorm. I get the following error in the runner: TypeError [ERR_INVALID_STATE]: Invalid state: Controller is already closed at ReadableStreamDefaultController.enqueue (node:internal/webstreams/readablestream:1077:13) at D:\Temp2025\ng20\node_modules@͏angular\build\src\builders\karma\application_builder.js:253:28 at Timeout.removeAllListeners [as _onTimeout] (D:\Temp2025\ng20\node_modules\karma\lib\server.js:468:9) at listOnTimeout (node:internal/timers:588:17) at process.processTimers (node:internal/timers:523:7) { code: 'ERR_INVALID_STATE' success 0.635
Init_set_Junie_1_install How to install Junie? success 0.656
Init_set_Webstorm_5_Debug The user complains that a debug session starts in a new blank instance of the browser. success 0.702
Init_set_Webstorm_4_freeze The user complains that the IDE freezes after start and he/she is unable to do anything. failure 0.667
Init_set_Webstorm_2_Performance My WebStorm operates slowly - completion, navigation success 0.391
Init_set_Webstorm_3_Tailwind The user says that Tailwind completion does not work failure 0.772
Init_set_Rider_4_ETW JetBrains ETW service is not uninstalled together with Rider success 0.711
Init_set_Rider_3_crash_I9 Rider crashes after opening a project in an Intel i9 CPU success 0.630
Init_set_Rider_2_dotNet Rider shows a lot of red code across the whole solution, .NET SDK symbols not resolved success 0.638
Init_set_Rider_1_Formatting How to share formatting settings with the whole team? failure 0.371