Optionally support ARM setup

[raravena80]

Description

Changes needed to support ARM without rerank with specific embeddings endpoint input/output of vllm

Need to optionally set

export EMBEDDINGS_USE_VLLM=true

Issues

n/a

Type of change

List the type of change like below. Please delete options that are not relevant.

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds new functionality)
• Breaking change (fix or feature that would break existing design and interface)
• Others (enhancement, documentation, validation, etc.)

Dependencies

List the newly introduced 3rd party dependency if exists.

Tests

Test locally with API successfully

curl http://localhost:8888/v1/chatqna     -H "Content-Type: application/json"     -d '{
        "messages": "What is the revenue of Nike in 2023?"
    }'
data: b''

data: b' As'

data: b' of'

data: b' now'

data: b','

data: b' the'

data: b' exact'

data: b' revenue'

data: b' of'

data: b' N'

data: b'ike'

data: b' for'

data: b' '

data: b'2'

data: b'0'

data: b'2'

data: b'3'

data: b' is'

data: b' not'

data: b' available'

data: b'.'

data: b' However'

data: b','

data: b' you'

data: b' can'

data: b' find'

data: b' the'

data: b' latest'

data: b' revenue'

data: b' information'

data: b' by'

data: b' searching'

data: b' for'

data: b' their'

data: b' financial'

data: b' reports'

data: b' or'

data: b' visiting'

data: b' their'

data: b' official'

data: b' website'

data: b'.'

data: b''

data: b''

data: [DONE]

[mkbhanda]

LGTM! Thank you @raravena80

[raravena80]

Reopened here due to DCO failing: #1237