Feature Engineering
This section entails introducing new features by either combining existing features or introducing new ones. Personally, I have always struggled with making the decision of whether I should invest time in collecting new dataset or spare more hope on what I currently have.
This section is organised by:
- Database management tasks to support user-event data structures
- Experimental basis
Database Background Workers
The Database background workers work with the main objectives:
- Organize and assert data quality issues.
- Prepare the dataset for me to tinker with.
Classifying Methods
Two methods:
- Sequence Vector with
SentenceTransformers. - BART Model with
transformers.
I settled with the first option due to costs considerations and the ease of fine-tuning.
Initialized Classification Labels
The following table displays the life themes labels with their respective example questions. These draft the possible classification labels to initialize classification pipelines.
| Category | Description | Example Questions |
|---|---|---|
| Love & Relationships | Romantic interests, soulmates, breakups, dating. | “Will I meet someone soon?” |
| Career & Ambitions | Career moves, promotions, purpose. | “Should I change jobs?” |
| Finance & Wealth | Money, savings, financial struggles. | “Will I be financially stable?” |
| Health & Wellness | Physical, mental, and emotional well-being. | “How can I improve my health?” |
| Family & Home | Family dynamics, children, and living situation. | “Will my home life become more peaceful?” |
| Personal Growth | Healing, self-discovery, learning, emotional development. | “How can I grow emotionally?” |
| Friendships & Social Life | Social circles, trust, and belonging. | “Why do I feel so isolated from others?” |
| Spirituality & Purpose | Soul path, meaning, karmic lessons, existential questions. | “What am I meant to learn in this lifetime?” |
| Decisions & Dilemmas | Hard choices, forks in the road, evaluating options. | “Should I move or stay?” |
| Timing & Future | Questions about when events will occur or improve. | “When will things improve for me?” |
| Creativity & Expression | Creative projects, artistry, and self-expression. | “Will my art reach others?” |