ASTROLOGY�aa

Generative AI Project

Written by:�Adalbert Tibiássy�Roland Weiszmüller

17.12.2025

ELTE

1

• Astrology definition: a belief that the positions and movements of celestial bodies influence human life
• Astrologers create horoscopes, predictions for the future (usually daily or a given timeperiod)
• Zodiac connection: 12 zodiac star signs, that correspond to some personalities

​

Aries 03.21-04.19

Bold

Taurus 04.20-05.20

Reliable

Gemini 05.21-06.20

Curious

Leo 07.23-08.22

Confident

Virgo 08.23-09.22

Analytical

Libra 09.23-10.22

Diplomatic

Scorpio 10.23-11.21

Intense

Sagittarius 11.22-12.21

Adventurous

Aquarius 01.20-02.18

Independent

Pisces 02.19-03.20

Empathetic

Cancer 06.21-07.22

Nurturing

Capricorn 12.22-01.19

Ambitious

2

Aries 03.21-04.19

Bold

Taurus 04.20-05.20

Reliable

Gemini 05.21-06.20

Curious

Leo 07.23-08.22

Confident

Virgo 08.23-09.22

Analytical

Libra 09.23-10.22

Diplomatic

Scorpio 10.23-11.21

Intense

Sagittarius 11.22-12.21

Adventurous

Aquarius 01.20-02.18

Independent

Pisces 02.19-03.20

Empathetic

Capricorn 12.22-01.19

Ambitious

Cancer 06.21-07.22

Nurturing

3

• Idea was: generating horoscopes
• If the AI is good in pseudo-science
• Generating horoscopes for the given day and cathegory and sign
• Generating images from famous people
• Are we able to predict your face from your zodiac

4

• Database 1: sign – date – prediction
• The prediction: general advice + love + luck in text form
• Database 2: sign – cathegory – date – prediction – only text

​

​

5

Model 1 LSTM

LSTM: Long-Short Term memory

• Sequential patterns
• Long term relations
• Important: interpretations have time “dependence”, since the date is time “dependent”
• For textgen: using NLP - it should work for little datasets and shorter texts
• For hybrid architecture: combined with CNN/attention multiple layers can be be implemented

6

Model 1 LSTM

LSTM: Long-Short Term memory

• Trained for the prediction: sign + date 🡪 prediction
• Characterwise encoding

RESULTS:

• Successful character pred.: 73-78%
• Test loss: ~0.81
• The text are completely unhuman

   Actual:    Meditation will prove a good remedy in countering mental tensions. Don’t trust anyone with your money

   Predicted: alexorenanananarenareadenanarenanalonananananakenanadenanareadanananananadenanaredenanananadenananad

7

Model 1 LSTM

LSTM: Long-Short Term memory

• Trained for the prediction: sign + date 🡪 prediction
• Characterwise encoding

RESULTS:

• Successful next character pred.: 73-78%
• Test loss: ~0.81
• The text are completely unhuman

Actual:   

Meditation will prove a good remedy in countering mental tensions. Don’t trust anyone with your money

8

Model 1 LSTM

LSTM: Long-Short Term memory

• Trained for the prediction: sign + date 🡪 prediction
• Characterwise encoding

RESULTS:

• Successful next character pred.: 73-78%
• Test loss: ~0.81
• The text are completely unhuman

Actual:   

Meditation will prove a good remedy in countering mental tensions. Don’t trust anyone with your money

Predicted: alexorenanananarenareadenanarenanalonananananakenanadenanareadanananananadenanaredenanananadenananad

9

Model 1 LSTM

Actual:   

An adventure activity can give you the high you seek! You will have to make some efforts to impress others

Predicted: renanadexenaronacorenanastanananarenanarenananarenanarexexevexenananarevenakedeananadunananachananal�Actual:   

Starting an exercise routine will help you in overcoming lethargy. Financial problems facing you will deal with

Predicted:

ananarenanareananakelokeadena �Actual:

An investment is likely to give good returns. Something started on the exercise front is likely to stay longer in your life

Predicted: nanarenananarenadenananadinadenareveThareananadenadealanalexonananadareananananadedarenanananaronana

10

Model 1 LSTM

LSTM: Long-Short Term memory

• Trained for the prediction: sign + date 🡪 lucky number pred.�If the characters are not good, try the numbers

RESULTS:

• Successful number pred. compared to the training set: 54.68%
• Every predicted lucky number: Unknown
• The dataset contained ‘Unknown’ ~54.68%

11

Model 1 LSTM

LSTM: Long-Short Term memory

• Trained for the prediction: sign + date 🡪 lucky number pred.�If the characters are not good, try the numbers

RESULTS:

• Successful number pred. compared to the training set: 54.68%
• Every predicted lucky number: Unknown
• The dataset contained ‘Unknown’ ~54.68%

Predicted Actual

Unknown 5.0

Unknown Unknown

Unknown 6.0

Unknown Unknown

Unknown 9.0

Unknown Unknown

Unknown Unknown

Unknown Unknown

Unknown Unknown

Unknown 22.0

12

Model 1 LSTM

LSTM: Long-Short Term memory

• Trained for the prediction: sign + date 🡪 prediction
• Tokenizing:

RESULTS:

• In the beginning the loss did not decrease with the epochs
• Generated sequential characters, like “of of of …” or “ownownown…”
• It might find a local minima 🡪 increase the epoch + hidden dimensions + layer number

13

Model 1 LSTM

Actual:�Take time to steady yourself on the financial front. Health looks up, as you feel more fit and energetic

Predicted:

imonanananana inanana ananananananaprexea inanananananananananananamonanananana ananananaad

Actual:�Becoming the centre of attraction in a gathering is a foregone conclusion. Your performance is likely to increase

Predicted: 

anananaanathaanaatremona oprexonareaananananana anananamonaca anana ona prevemaca a onana anan

Actual:�Starting an exercise routine will help you in overcoming lethargy. Financial problems facing you will deal with

Predicted: 

wenananananavexonananana prexananabonanananamanananavefomanananananananacananananananana

Actual:�An adventure activity can give you the high you seek! You will have to make some efforts to impress others

Predicted: 

gunavinananasunanalolananaconanamonaçonanananamonathaνina ananacaçanana inanananana onan

14

Model 1 LSTM

LSTM: Long-Short Term memory

• Trained for the prediction: sign + date 🡪 prediction
• Tokenizing improved: �epoch: 40🡪60 ; layer 2 🡪3 ; hidden dim: 256 🡪336

RESULTS:

• It got slower but it still generated repeating characters
• The characters were similar to ”unknow” 🡪 the empty lines were filled with the “unknown” string
• There was no normal text output

REASONS:

• too small dataset
• too “bad” dataset

15

Model 1 LSTM

LSTM: Long-Short Term memory

• Trained for the prediction: sign + date 🡪 prediction
• Tokenizing improved: �epoch: 40🡪60 ; layer 2 🡪3 ; hidden dim: 256 🡪336

RESULTS:

• It got slower but it still generated repeating characters
• The characters were similar to ”unknow” 🡪 the empty lines were filled with the “unknown” string
• There was no normal text output

REASONS:

• too small dataset
• too “bad” dataset

IMAGE GEN

IMAGE GEN

16

Model 1 LSTM

LSTM: Long-Short Term memory

• Trained for the prediction: sign + date 🡪 prediction (no cathegory)
• Tokenizing improved: �Better dataset

RESULTS:

• The training time increased
• The results were the same for every date
• Slight differences for diff. signs, but basically the same

IMAGE GEN

IMAGE GEN

17

RESULTS:

• The training time increased
• The results were the same for every date
• Slight differences for diff. signs, but basically the same

IMAGE GEN

IMAGE GEN

Actual:   

Meditation will prove a good remedy in countering mental tensions. Don’t trust anyone with your money

Predicted:

evevevevevevevevevevevevevevevevevevevevevevevevevevevevevevevevevevevevevevevevevevevevevevevev

LSTM: Long-Short Term memory

• Trained for the prediction: sign + date 🡪 prediction (no cathegory)
• Tokenizing improved: �Better dataset

Model 2 GPT 2

18

Model 1 LSTM

IMAGE GEN

IMAGE GEN

Generative Pretrained Transformer

• Larger training size
• Good for text gen
• Needs to be trained 🡪 the better was used
• Trained for no-category and for with category as well

19

Model 1 LSTM

IMAGE GEN

IMAGE GEN

Gemini, 2025-12-17

You are the star of the show all these weeks, so choose wisely. Any perceived problem with your work will be greatly exaggerated. Don't be afraid to ask for more time. It will solve the problem. You are in a good position to make the most of the week. Relax and enjoy your day. You are in a good position to get to know you better. Enjoy your day. Go to bed early - and wake up early if necessary. Relax to your own little secret. You are in a good position to make the most of this fantastic time. Feel free to share more of it with the world. Let go of fear and embrace the bliss of being loved! It's a wonderful, romantic year! Have a tender, intimate last month! Have a glorious year! Love, brilliance, and love are yours! Mature, mature, and mature! Your whole year is precious and treasureful! What a magnificent year! Have a magnificent year! Love and cherish it all! It's a magnificent, magnificent year! Do great things with it all! Love and cherish it all! It's a magnificent, magnificent year! What an amazing year! Be loved all year! Love is in the air all year! It's a magnificent, magnificent year!

Repetition

20

Model 1 LSTM

IMAGE GEN

IMAGE GEN

Leo, 2025-12-17

Don't let yourself get carried away in a particular situation today. You are more likely to get hurt than hurt in the process. Remember that this is only a phase - don't let it get you too far. The best thing you can do to avoid any kind of conflict is to find a friend who is willing to take the time to help just for you. You might as well go for it. The more you can do, the better. Trust yourself! It will help you in the long run. Enjoy your day. If you’re feeling a little downhearted, go for it! It’s only a phase. Drink lots of water and get plenty of rest. It’s never too late! Have a great day! And don’t forget to keep smiling! Love yourself, too! And remember to love yourself! It’s a powerful, empowering year! End the year with rich love, powerful love back, and a powerful year! End the year smarter, more powerful, and more powerful! It's a powerful, empowering year! Have a great year! Love is in the air! End the year more passionately, passionately, passionately! It's a powerful, empowering year! The year is full of love!

Repetition

21

Model 1 LSTM

IMAGE GEN

IMAGE GEN

Cancer, 2025-12-17

The present planetary alignment is creating a favorable atmosphere for your love interest to make a move, and you will feel like you are in the right place at the right time. The present planetary alignment is encouraging you to feel like you have a chance to talk, and this is a wonderful opportunity for you to have a great time. You will enjoy every minute of the conversation, and will find it to be quite delightful. Give in to your excitement and take it your way. It will all be well. Enjoy. Let your love life bloom! End the day with a passionate love! So much love! It's a wonderful, romantic day! It's a very lucky day for you. Have a great year! Have a loving year! Great love! And a very special year! Love, too! It's a very powerful year! It's a very powerful year! It's a very powerful year! It's a very powerful year! Let it love you! Love, too! It's a very powerful year! Let it love you! It's a very powerful year! Let it love you! It's a very powerful year! It's a very powerful year! Let it love you! Let it love you! You're loved the way it is!

Repetition

22

Model 1 LSTM

IMAGE GEN

IMAGE GEN

RESULTS:

• The generated text were relatively good compared to the LSTM
• Grammatically correct, coherent texts
• The categories were mixed into one message

​

PROBLEMS:

• Some repeated sentences/words
• The model “likes” some words: e.g. “powerful”

​

23

Model 1 LSTM

IMAGE GEN

IMAGE GEN

RESULTS:

• The generated text were relatively good compared to the LSTM
• Grammatically correct, coherent texts
• The categories were mixed into one message

​

PROBLEMS:

• Some repeated sentences/words
• The model “likes” some words: e.g. “powerful”

​

24

Model 1 LSTM

IMAGE GEN

IMAGE GEN

Pisces, 2025-12-15, �category: GENERAL

​

You could be in a difficult spot, Pisces. You've just been trying to figure out what you need to do to move forward with a new partnership. It might feel like the only way forward is to continue with the old. Today, you need to think beyond the past, to embrace the future. Today's planetary energy makes the best case for that. You can't wait to begin. It's time to get moving! Continue on! You'll find that your mind is on the future for the better. You will be happier. Take care of yourself. Don't overreact! It's a beautiful day! Stay positive and loving! Enjoy your time together! It's a great day for getting your life together! Love, love! There's no need to panic, no matter what! It's a powerful year! A love that really shines! This is your time! You have it all! It's a powerful year! Let's see how far you can go! It's a great year! Have a great year! Love, love! You're with so much! It's a powerful year! It's a powerful, powerful year! Love, love! It's a great year! Have a wonderful year! It's a powerful, powerful year!

Repetition

25

Model 1 LSTM

IMAGE GEN

IMAGE GEN

Pisces, 2025-12-15, �category: LOVE

​

Although you may have a lot to say to someone, you will find that you just don't get it. The planetary energy indicates that you have only one option - to do something about it. It is better to keep that door open and be in the right place at the right time, rather than letting them all get in. You both need to sit down and talk. If possible, make this your first date. Be sure to get as much out of each other as possible. No one can do this. Give each other the benefit of time and space, and then find a place that suits your needs! Then you may find that you really want to be together again. Be gentle and sensible! It will be the best! Go! Love is around the corner!

Incoherence

26

Model 3 GPT-Neo 125M

IMAGE GEN

IMAGE GEN

GPT-NEO 125M

• Open-source GPT-3 like model, with 125 million parameters
• Developed by EleutherAI
• Decoder-only transf. architecture
• Trained again differently for no-category and for category

​

27

Model 1 LSTM

IMAGE GEN

IMAGE GEN

Gemini, 2025-12-17

​

You are known as a very good listener, and this is a wonderful feeling to have. You will find that people like you and want to hear from you. To enhance this feeling, take an active role in socializing. If you are single, you will probably feel more attuned to your own needs and desires. This is a good day to bring out your favorite art and music and to listen to your favorite music. It will make you feel good. Go for it! This is a wonderful day to visit or do something special, especially if you are single. Get your own needs and needs into your own life and make room for your own happiness! It's a great day to get down on the floor and listen to your favorite music. It's a great day to get off and do something rather special, like a dance oruch, oruch as a special gift. Go for it! Have fun! It's a great day to find love! Have fun! Have fun! The one thing that may get overlooked is your natural friends! It's a magical day! Have a great week! Be inspired and clever! It's a lovely day to make a surprise surprise! Share it! Have a great week! Have fun exploring new interests and pursuing new love!

Repetition and strange things… (oruch?)

28

Model 1 LSTM

IMAGE GEN

IMAGE GEN

Leo, 2025-12-17

​

It's a great year full of creative comforts and a few innocent "guilty" pleasures! Keep control of those unwanted but highly-intense pleasures and get full benefits of being a lifetime risk that works for you. Your natural charm will bring you a great deal. If you've been putting off the pleasures until later, this is a great year to get started. Be sure to get healthy and active in the first month and how much is in the second. Be popular inure! Share and be loved all year! What You May Be Love From a Cleverness Circumstanced: November is a busy, emotional day with many friends Friends and neighbors are at work in the next two months. Be at your best in December,cellence in the gift of words and love, and a few cents' worth of fun! Be at your best when the year ends with a powerful, karmic love! Be at it! Love can sometimes be a great partner, and it's what makes the year end! It's a magnificent year! It's a great year! It's a sizzling start and a great enemy! Have fun!ietsd October, playfulness willelaide be a smile: December a sweet burst of passion can turn your heart straight 

Stranger things…

29

Model 1 LSTM

IMAGE GEN

IMAGE GEN

Cancer, 2025-12-17

​

Your birthday year gets off to a great start as you explore new possibilities in love and romance. However, the more interested in your friends the more inclined you will be in love. However, it may be hard to keep up with new and exciting people in the springtime, so it might be best to avoid arguments or heavy social events. If you're single, then it might be time to make a fresh start. Go to a small online class or college, mostly free, and try out a new way of looking at the world. Then, when the time is right, may as well be November! Love is a popular person's love. It's deep, beautiful, and full of tenderness that makes you human! It's a powerful love, and you have to let it go. Use it to your advantage and you'll be a winner! It's a powerful work-your-luck! It's a powerful, powerful time! Love is a powerful, powerful time! It's a powerful, powerful time! Work, mostly today, at a virtual class or class-filled virtual gym! You'll be surprised how people love you! Your friends will thank you for it! It's a powerful, powerful year! Have a great year! The whole year!

Repetition and incoherente time prediction

30

Model 1 LSTM

IMAGE GEN

IMAGE GEN

Leo, 2025-12-17

Category: GENERAL

​

A great deal of energy and passion may be shed on the subject today, Leo. You may be in a good place to make it more clear. It's likely that you will be able to do a lot more than you normally do. You will find that you get a lot of good support and encouragement from others and even some personal contact. Try to take this opportunity to let your emotions go. Feel the feelings. Feel the joy! Feel the pain! You feel the pain more than you normally do! Try to let it go, as it would help you to feel more deeply and deeply. It's a beautiful day! Give it all you have! Have feelings! Your feelings are powerful and will come to you eventually! Go for it! Go for it! Love yourself! Love yourself! Love yourself! Love yourself! Love yourself! It's a beautiful day! Be fearless! You're ready! Have an awesome laugh! Everyone will love you! Feel the joy! Feel the pain! Feel the joy! Feel the pain! Feel the pain! Feel the pain! Love yourself! Love yourself! Love yourself! You're ready! Go for it! Go for it! Go for it! Get your own way! Get your own way! Get your own way!

Repetition

31

Model 1 LSTM

IMAGE GEN

Leo, 2025-12-17

Category: LOVE

​

You can be quite sociable today, and you could even say that your sugar honey is a little sugar honey, with whom you have a lot of social and romantic interests. But the planetary influence indicates that you will have to do more to attract this person, so watch this. If you have any issues concerning your love life, be sure to do your best to listen. This could also be a wonderful day to get your heart in tune and express your true feelings. Be sure to go in more than you may have to before going home! Enjoy! Go for it! Go for it! Go for it! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! Go! = love = HOROSCOPE: The current aspect gives you a feeling of freedom and freedom of movement. You will be able to experience a new kind of life if you follow your heart. Go for it!

Repetition and very strange

32

Model 1 LSTM

RESULTS:

• Still repeated and some incoherence, and strange word use
• The category training provides a smaller training data for each type of prompt
• It also could generate horoscope from not trained category (like: health, money)

33

Model 1 LSTM

• For faces: theneuralmaze/celebrity_faces
• For birth data: vedastro-org/15000-Famous-People-Birth-Date-Location

34

Model 1 LSTM

IMAGE GEN

• Pictures + Labelling
• Full dataset, but ~50 pic about each celebrity 🡪 real variance: 80-200 diff. person

35

Model 1 LSTM

IMAGE GEN

36

Model 1 LSTM

IMAGE GEN

The variational encoder

37

Model 1 LSTM

IMAGE GEN

Learning performance

• Adam optimiser (most common)
• smooth curves: stable optimisation
• Converged curves - the system reach their maximum performance (If we are able to say that after 20 epochs - probably not) 

38

Model 1 LSTM

IMAGE GEN

VAE – RESULTS 64x64 pictures

Contras:

• No sharp image
• Lot of blurry or lot of place filled with “gray noise”

��Pros:

• humanlike faces (mixed with dogs and dementors)
• eyes, noses, mouths are in the correct place
• different faces for different Zodiac signs

�

39

Model 1 LSTM

IMAGE GEN

VAE – Conclusion 64x64 pictures

• 64x64 isn’t enough large
• Few pixels 🡪 no details
• the latent vector was to small
• beta regularisation parameter choosing? 

40

Model 1 LSTM

IMAGE GEN

VAE II – Duplicated size

• 128x128 pictures
• 5 conv layers
• doubled latent dimension size

​

​

Bit more humanlike faces

41

Model 1 LSTM

IMAGE GEN

The Conditional Generative Adversarial Network

42

Model 1 LSTM

IMAGE GEN

CGAN I

• Mode Collapse - Dominant discrimator: 
• Generator loss has an extreme fluctuation
• Discriminator loss is low and stable
• Generator is unable to improve more, to noisy
• Possible Issues:
• 100 epoch is to much 🡪 overfitting on noise?
• feature vector sizes 
• test run : batch size 256 !!!

43

Model 1 LSTM

IMAGE GEN

CGAN II

• Changes: 
• Feature vector from 64 to 128 
• Slowing down the discriminator : learn only in each odd step
• Label smoothing : real = 1*0.9, fake = 0+0.1
• batch size 128 
• Conclusion:
• to noisy
• generator discriminator more equal 
• too much information to process: 
• smaller feature vector
• smaller batch size

44

Model 1 LSTM

IMAGE GEN

CGAN III

• Changes: 
• Feature vector back to 64
• batch size 64
• Conclusions : 
• probably the best results
• less dementors and dogs on the picture
• the feature vectors was to large :
• too much information try to contain in a small figure 🡪 “periodic noise”
• Aries and Virgo almost the same! :
• downscaled pics isn’t enough
• the dataset isn’t enough large?�

45

Model 1 LSTM

IMAGE GEN

The Diffusion model

46

Model 1 LSTM

IMAGE GEN

Diffusion results and conclusion

• small U net model 🡪 only 3x2 layer
• unable to catch the details  (eyes, contours)
• best performance, most “humainc” faces in the chaos
•  only 20 epoch : noise distribution could be to “rough”

47

Model 1 LSTM

IMAGE GEN

• To build the models: corresponding parts from the lecture notes 
• Understanding Diffusion models: Yang, L. et. al.  (2022). Diffusion models: A comprehensive survey of methods and applications. arXiv.2209.00796v15
• Understanding U-Net: Alejandro Ito Aramendia, Decoding the U‑Net: A Complete Guide, Medium, 2024.
• To write the code faster and more accurately: Claude-Sonet LLM�