Image-Evaluation #162
Open
Image-Evaluation #162
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* update promptflow-eval dependencies to azure-ai-evaluation * clear local variables * fix errors and remove 'question' col from data * small fix in evaluator config * Restructuring evaluation samples for consistency and clarity * remove key * disable pre-commit errors * address some comments * format and linter * bring modelendpoints into notebook * pre-commit fixes * index sample update * add more advanced use of simulator * fix env vars * fix user override prompty
* update promptflow-eval dependencies to azure-ai-evaluation * clear local variables * fix errors and remove 'question' col from data * small fix in evaluator config * update docs and add column mapping * pre-commit fixes
…lines (Azure-Samples#141) * update promptflow-eval dependencies to azure-ai-evaluation * clear local variables * fix errors and remove 'question' col from data * small fix in evaluator config * update docs and add column mapping * pre-commit fixes * remove keys from eval sdk samples and update util to to_eval_qr_json_lines * fix typos in readme
Adding link to Phi-3Cookbook for SLM examples
* update promptflow-eval dependencies to azure-ai-evaluation * clear local variables * fix errors and remove 'question' col from data * small fix in evaluator config * add groundedness sample * adding and fixing readme
* add ai sdk samples for inference and rag * remove outdated rag sample * Update chat-template.py (Azure-Samples#146) change comment dashes to underscores. Docs platform having trouble with the current ids. * Update chat-template.py (Azure-Samples#147) add extra space to top * use underscores in doc comments * add basic projects samples for docs * update custom rag app logging and evaluation * update basic readme * add search to basic samples * remove unused import from create_search_index * fix requirements.txt files * update rag sample from bug bash * README update and code fix for param * add initial tests * update readmes add test for rag * readme tweaks * run linters * fix linter and formatting errors * remove packages * move scripts from chat-app into projects * Add services to rag readme --------- Co-authored-by: Sheri Gilley <[email protected]> Co-authored-by: Leah Bar-On Simmons <[email protected]>
* update promptflow-eval dependencies to azure-ai-evaluation * clear local variables * fix errors and remove 'question' col from data * small fix in evaluator config * Add sample for Remote Evaluation * code review updates * adding online evals, code review updates * Separate remote and online samples
* update promptflow-eval dependencies to azure-ai-evaluation * clear local variables * fix errors and remove 'question' col from data * small fix in evaluator config * init * integrate online and remote changes * update hyperlinks * update hyperlinks again * update hyperlinks third and final * change remote eval to eval on cloud
* update promptflow-eval dependencies to azure-ai-evaluation * clear local variables * fix errors and remove 'question' col from data * small fix in evaluator config * move-online-remote
* update promptflow-eval dependencies to azure-ai-evaluation * clear local variables * fix errors and remove 'question' col from data * small fix in evaluator config * update Azure AI Projects import
* add hub files from Samples/azure-ai and update README * Add secrets check to pre-commit * Remove unrelated changes * Don't run secrets check on remote, only local check
Fixed a typo
* refactor(pre-commit): Remove duplicated pre-commit config * refactor: Move CI script out of repository root * refactor: Resolve lint issues in script
* update promptflow-eval dependencies to azure-ai-evaluation * clear local variables * fix errors and remove 'question' col from data * small fix in evaluator config * init * updates
minthigpen
reviewed
Dec 13, 2024
minthigpen
reviewed
Dec 13, 2024
scenarios/evaluate-with-images/inferences_qna_with_images.ipynb
Outdated
Show resolved
Hide resolved
Co-authored-by: Minsoo Thigpen <[email protected]>
Co-authored-by: Minsoo Thigpen <[email protected]>
diondrapeck
approved these changes
Dec 18, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.