[IN-19] Semantic Chunking Implementation

[osw282]

Semantic Chunking Implementation.

Checklist

Please ensure you have done the following:

• I have read the CONTRIBUTING guide.
• I have updated the documentation if required.
• I have added tests which cover my changes.

Type of change

Tick all those that apply:

• Bug Fix (non-breaking change, fixing an issue)
• New feature (non-breaking change to add functionality)
• Breaking change (fix or feature that would cause existing functionality to change)
• Other (add details above)

MacOS tests

To trigger the CI to run on a macOS backed workflow, add the macos-ci-test label to the pull request (PR).

Our advice is to only run this workflow when testing the compatability between operating systems for a change that you've made, e.g., adding a new dependency to the virtual environment.

Note: This can take up to 5 minutes to run. This workflow costs x10 more than a Linux-based workflow, use at discretion.

[d-lowl]

Looks good! A suggestion on adding some quantitative comparison between the naive, your semantic and langchain semantic chunking

[d-lowl]

Awesome