Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generator without classes #27

Open
aguacaate opened this issue Apr 8, 2020 · 2 comments
Open

Generator without classes #27

aguacaate opened this issue Apr 8, 2020 · 2 comments

Comments

@aguacaate
Copy link

Hey,
Thank you very much for your video generator!
I am now trying to train a LSTM with image sequences but as I want to train for a future GAN implementation I have no classes. How would I be able to apply your generator with no classes?
Would be grateful if you could help.

Thanks a lot
Cate

@metal3d
Copy link
Owner

metal3d commented Apr 10, 2020

I already tried (without good results for now). The idea is to make the "generator" (I mean the model part, not the VideoFrameGenerator) to output a shape of (B, N, W ,H , C) where B is the batch size (None ?) and N the number of frame.

Then use VideoFrameGenerator (or SlidingFrameGenerator) dropping class:

# index 0 is the batches of sequeces, index 1 is classes, you can ignore this index
bach = next(your_generator)[0]

I think the idea can be very interesting without using data augmentation (or not destructive).

I will try to give more details in my Medium account (my blog is french, my Medium is english)

@aguacaate
Copy link
Author

Yes! Actually I am trying to develop a many-to-one model so the output of the generator should only be one next frame.
Will work on it and share if I manage it successfully!
Thanks a lot for your reply and Ill wait for your Medium post.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants