Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Numpy Frontend Support to Ivy Transpiler #28847

Open
YushaArif99 opened this issue Dec 17, 2024 · 0 comments
Open

Add Numpy Frontend Support to Ivy Transpiler #28847

YushaArif99 opened this issue Dec 17, 2024 · 0 comments
Labels
NumPy Frontend Developing the NumPy Frontend, checklist triggered by commenting add_frontend_checklist ToDo A ToDo list of tasks Transpiler Anything related to transpiling

Comments

@YushaArif99
Copy link
Contributor

YushaArif99 commented Dec 17, 2024

Description:
The current implementation of ivy.transpile supports "torch" as the sole source argument. This allows transpiling PyTorch functions or classes to target frameworks like TensorFlow, JAX, or NumPy. This task aims to extend the functionality by adding Numpy as a valid source, enabling transpilation of Numpy code to other frameworks via Ivy's intermediate representation.

For example, after completing this task, we should be able to transpile Numpy code using:

ivy.transpile(func, source="numpy", target="jax")

Goals:

The main objective is to implement the first two stages of the transpilation pipeline for Numpy:

  1. Lower Numpy code to Ivy’s Numpy Frontend IR.
  2. Transform the Numpy Frontend IR to Ivy’s core representation.

Once these stages are complete, the rest of the pipeline can be reused to target other frameworks like JAX, PyTorch, or TensorFlow. The steps would look as follows:

source='numpy' → target='numpy_frontend'  
source='numpy_frontend' → target='ivy'  
source='ivy' → target='jax'/'torch'/etc.  

This mirrors the existing pipeline for PyTorch:

source='torch' → target='torch_frontend'  
source='torch_frontend' → target='ivy'  
source='ivy' → target='jax'/'numpy'/etc.  

Key Tasks:

  1. Add Native Framework-Specific Implementations for Core Transformation Passes:

    • For example, implement the native_numpy_recursive_transformer.py for traversing and transforming Numpy native source code.
    • Use native_torch_recursive_transformer.py as a reference (example here)
  2. Define the Transformation Pipeline for Numpy to Numpy Frontend IR:

    • Create a new pipeline in source_to_frontend_translator_config.py to handle the stage source='numpy', target='numpy_frontend' (example here).
  3. Define the Transformation Pipeline for Numpy Frontend IR to Ivy:

    • Add another pipeline in frontend_to_ivy_translator_config.py to handle the stage source='numpy_frontend', target='ivy' (example here).
  4. Add Stateful Classes for Numpy

    • NOTE: Numpy does not natively support any stateful classes so this step can be skipped.
  5. Understand and Leverage Reusability:

    • Explore reusable components in the existing PyTorch pipeline, especially for AST transformers and configuration management.

Testing:

  • Familiarize yourself with the transpilation flow by exploring transpiler tests
  • Add appropriate tests to validate Numpy source transpilation at each stage of the pipeline.

Additional Notes:

  • Keep in mind the modular and extensible design of the transpiler, ensuring that the new implementation integrates smoothly into the existing architecture.
@YushaArif99 YushaArif99 added NumPy Frontend Developing the NumPy Frontend, checklist triggered by commenting add_frontend_checklist ToDo A ToDo list of tasks Transpiler Anything related to transpiling labels Dec 17, 2024
@YushaArif99 YushaArif99 changed the title <Function_Name> Add JAX Frontend Support to Ivy Transpiler Dec 17, 2024
@YushaArif99 YushaArif99 changed the title Add JAX Frontend Support to Ivy Transpiler Add Numpy Frontend Support to Ivy Transpiler Dec 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
NumPy Frontend Developing the NumPy Frontend, checklist triggered by commenting add_frontend_checklist ToDo A ToDo list of tasks Transpiler Anything related to transpiling
Projects
None yet
Development

No branches or pull requests

2 participants