Is it intentional that "role: system" part of API request is not at position 0 of the json object? #5139
Unanswered
Originalimoc
asked this question in
Q&A
Is it intentional that "role: system" part of API request is not at position 0 of the json object?
#5139
Replies: 2 comments
-
|
Yes it’s intentional. Since a lot of custom endpoints don’t seem to support this, I’ll change this or at least make it an option to place at index 0 instead of length - 2. |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
What's the benefit? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
What happened?
Some API provider will just add the system prompt as a second one instead of replacing the default one defined in Jinja2.
Steps to Reproduce
Seems long prompt will put the system prompt at second last instead of first? Not 100% reproducible.
What browsers are you seeing the problem on?
No response
Relevant log output
No response
Screenshots
No response
Code of Conduct
Beta Was this translation helpful? Give feedback.
All reactions