-
Notifications
You must be signed in to change notification settings - Fork 471
Issues: explodinggradients/ragas
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
TestsetGenerator.from_langchain Generating failed, randomly stuck at 0% to 80%.
bug
Something isn't working
module-testsetgen
Module testset generation
question
Further information is requested
#1003
opened Jun 2, 2024 by
pp6699
I've been encountering an issue where Ragas generates test cases from the initially uploaded documents, even after updating the documents and rerunning the process. It either uses the old documents or mixes them with the new ones.
bug
Something isn't working
module-testsetgen
Module testset generation
question
Further information is requested
#1002
opened Jun 1, 2024 by
AliHaider0343
Output testset when using Llama 3 8B instruct model is not proper.
question
Further information is requested
#1000
opened May 31, 2024 by
Nandakishore-Thekkadathu
Evaluation Error with Gemini/VertexAI: InvalidArgument due to Empty Text Content
bug
Something isn't working
#996
opened May 28, 2024 by
baptiste-pasquier
Using context utilization without ground truth throws error message
bug
Something isn't working
#993
opened May 28, 2024 by
dschwalm
How to save reason of each evaluation metrics?
enhancement
New feature or request
module-metrics
this is part of metrics module
#992
opened May 28, 2024 by
JinSeoung-Oh
[R-262] ImportError: llama_index must be installed to use this function. Please, install it with Something isn't working
linear
Created by Linear-GitHub Sync
module-testsetgen
Module testset generation
pip install llama_index
.
bug
#991
opened May 27, 2024 by
Prabhjot410
division by zero when computing output score
bug
Something isn't working
#989
opened May 25, 2024 by
theoden8
is_async missing in context_relevancy in ragas 0.1.8
bug
Something isn't working
module-metrics
this is part of metrics module
#986
opened May 23, 2024 by
abetatos
Can this part of the code be applied to Chinese scenarios
question
Further information is requested
#985
opened May 22, 2024 by
w666x
[R-256] make better example dataset for getting started
Improvement
Created by Linear-GitHub Sync
module-testsetgen
Module testset generation
#978
opened May 21, 2024 by
jjmachan
Tried Generation Test Set from Together APIs and Hugging Face Embeddings
bug
Something isn't working
#977
opened May 20, 2024 by
Eknathabhiram
Un-deprecate multiple ground truth answers?
enhancement
New feature or request
#968
opened May 17, 2024 by
athewsey
Is it possible to add an argument to the evaluate() function to configure the group name?
enhancement
New feature or request
#967
opened May 17, 2024 by
zzzmc
Testset generation ValueError: invalid literal for int() with base 10:
bug
Something isn't working
#966
opened May 17, 2024 by
choshiho
Answer Correctness giving wrong results for batches and single records
bug
Something isn't working
#965
opened May 17, 2024 by
aravindpai
Adapted output keys set(output.keys())={'深度', '相关性', '清晰度', '结构'} do not match with the original output keys: output_keys[i]={'structure', 'clarity', 'depth', 'relevance'}
bug
Something isn't working
#964
opened May 17, 2024 by
qism
TestsetGenerator -> RuntimeError: ... got Future <..> attached to a differen t loop
bug
Something isn't working
#963
opened May 16, 2024 by
abetatos
embedding nodes: 0%| Segmentation fault (core dumped)
bug
Something isn't working
#962
opened May 16, 2024 by
WGS-note
AttributeError: 'PhiForCausalLM' object has no attribute 'generate_prompt'
bug
Something isn't working
#960
opened May 16, 2024 by
TheDominus
Random RuntimeError: Tool context error detected. This can occur due to parallelization
bug
Something isn't working
#957
opened May 15, 2024 by
franck-cussac
1 task done
issue with metrics evaluation in case of any exception
bug
Something isn't working
#956
opened May 15, 2024 by
mukuls-zeta
[R-254] Issue in Evaluation using local LLM
linear
Created by Linear-GitHub Sync
question
Further information is requested
#955
opened May 15, 2024 by
sheetalkamthe55
Failed to parse output. Returning None. - SimpleEvolution - TestsetGenerator
bug
Something isn't working
#945
opened May 10, 2024 by
JPonsa
Previous Next
ProTip!
Exclude everything labeled
bug
with -label:bug.