AI for Trading: For Real or Just a Buzzword?

Introduction to AI Trading

At its core, AI in trading involves applying intelligent systems to tasks that once required human cognition: analysing data, recognising patterns, making predictions, and quant practitioners.

AI is a rapidly expanding segment of the fintech industry, with the global AI trading market valued at $18.2 billion in 2023, projected to nearly triple by 2033.

AI is transforming the trading landscape by enabling both advanced modelling and user-friendly automation.

• At the high end, sophisticated architectures like self-attention and cross-attention transformers analyse complex financial time series to generate powerful features for strategies such as optimal capital allocation through Deep Reinforcement Learning (DRL).
• At the same time, AI bots and large language models are democratizing trading by assisting users, regardless of coding expertise, in building, analysing, and executing trading strategies.

From deep market analysis to intuitive AI assistants, the technology is also reshaping how investors interact with financial markets. So, while there is undoubtedly a lot of buzz and risks around it, AI in trading is far from being just a buzzword.

Evolution of AI in Trading

The application of machine learning models and artificial intelligence in trading and investment began in the 20th century and has gained significant momentum in recent years.

• 1960s – Early ML in Finance: The foundations of AI in trading began in the 1960s with quantitative pioneers like Ed Thorp, who used computers for statistical arbitrage and portfolio optimisation. This marked the first wave of systematic trading.
• 1980s–1990s – Classical Machine Learning: As computing power grew, firms began applying early machine learning techniques like decision trees and support vector machines. Hedge funds, such as Renaissance Technologies, leveraged these models for predictive analytics and strategy development.
• 2010s – Rise of Deep Learning: The deep learning era brought neural networks, CNNs, and RNNs into the trading world. These models could identify complex temporal and spatial patterns in financial data, powering more dynamic trading strategies.
• 2020s – Generative AI & LLMs: Large Language Models (LLMs) and generative AI transformed the landscape again. These models now assist in research automation, generate new trading features, and even help design entire trading strategies autonomously.

Upcoming Webinar |  Algorithmic Trading Conference 2025

How AI Is Reshaping Trading Today
Explore AI’s impact on trading and what the future holds. Part of QuantInsti’s 15th anniversary, marking our journey in delivering world-class education and technology. The QuantInsti Algorithmic Trading Conference brings together some of the most influential voices leading this change.

Hear directly from:
Tucker Balch, Professor at Emory University and former Managing Director at J.P. Morgan, where he led the AI Research group
Peter Cotton, Co-Founder of Crunch Lab and creator of Microprediction, with leadership experience at JPMorgan, Intech, and ExodusPoint
Faisal Khan, Managing Director at Dynamiq Research, bringing deep expertise in systematic execution from a fund management perspective
Matteo Campellone, Executive Chairman at Brain Algorithms and a thought leader in AI-powered investment strategies
Dr. Robert Kissell, President of Kissell Research Group and a globally recognized expert in trading cost analytics and market microstructure

From cutting-edge AI models to practical quant systems used in live markets, this event is designed for traders, researchers, and technologists who want to stay ahead.

Date: Tuesday, 23 September 2025
Time: 6:00 PM IST | 8:30 PM SGT | 8:30 AM EDT

Visit quantinsti.com/algorithmic-trading-conference to explore the full agenda and register.

How is AI used in different steps of trading?

AI is integrated across the entire trading process, from raw data to trade execution:

1. Market Data Processing

The foundation of any quant strategy begins with analysing and preparing data, which includes:

• Numerical data: Historical price data, order books, financial statements.
• Relational data: Networked relationships between financial data and metrics.
• Alternative data: Text, images, or audio (e.g., news, social media sentiment).
• Simulation data: Synthetic datasets to supplement real-world gaps.

AI is used to analyse market data, create features (or factors) from this data, such as momentum, volatility, valuation metrics, and technical indicators, which are then fed into predictive models.

Check out Quantra’s self-paced course on Feature Engineering by Dr. Ernie Chan.

2. Model Prediction

At this stage, models forecast future asset behaviour (e.g., price movements, volatility). AI is designed to capture key relationships:

• Temporal patterns: Using CNNs, RNNs, LSTMs, or transformers.
• Spatial patterns: Capturing interdependencies via self-attention or Graph Neural Networks (GNNs).
• Spatiotemporal interactions: Combining time-based and entity-based signals.

Models aim for either intermediate predictions (e.g., price direction) or end-goal optimisation (e.g., maximising portfolio returns).

Check out the modular learning track Artificial Intelligence in Trading which covers implementation of AI models such as RNN, LSTM, XGBoost, K-Means, DBSCAN Clustering on financial markets data; backtesting analysis and more.

3. Portfolio Optimisation

This step turns predictions into actual investment decisions by optimising asset allocation. While traditional techniques (e.g., Black-Litterman model) remain relevant, DL and Reinforcement Learning (RL) are increasingly used for capital allocation. RL is particularly suited for dynamic, goal-aligned portfolio management.

Two short courses on this topic:

1. Portfolio Optimisation: Hierarchical Risk Parity

2. Portfolio Optimisation: LSTM Networks

4. Order Execution

This final phase places trades to minimise costs and market impact. AI-driven order execution can process high-frequency data and can employ RL models to optimise order placement in real time, adaptively.

“(Machine Learning) is going to be viewed more and more like a tool that you use; just like EXCEL at some point became like a standard thing" - Stephen Jensen, March 2024, Panel Discussion on AI-Powered Trading

How is AI enabling more retail participation in algorithmic trading?

AI as a Coding Assistant: LLMs like Claude AI and ChatGPT are extensively used by individuals, even those with limited or no prior coding experience, to generate code for trading algorithms. These tools assist users in creating trading bots and giving trade ideas, making the process of developing automated trading systems more accessible. Users have reported success in building functional trading bots or components, suggesting a reduced barrier to entry for individuals seeking to generate trading ideas.

Sentiment Analysis: LLMs can also be utilised for sentiment analysis of news and social media, which can be integrated into predictive models.

Trading platforms are essential for AI-driven trading, offering tools to develop, test, and execute strategies. Many support the integration of Python and AI, featuring tools such as real-time data feeds, backtesting, and AI bots for signal generation and risk management. Some also offer no-code interfaces, making algorithmic trading accessible to non-coders.

Can I make money using ChatGPT or AI trading bots?

AI trading bots can struggle in real markets due to overfitting on historical data, unexpected market events, and their inability to adapt to changing economic conditions or irrational human behaviour.

There are crucial limitations and risks involved with using AI bots or ChatGPT without conceptual grounding that can impact profitability:

1. Risk of Overfitting: A significant challenge with Deep Learning is the risk of overfitting, which can lead to poor performance in live trading. Strategies generated or assisted by LLMs are particularly susceptible to this.

2. LLM Hallucinations and Illogical Results: LLMs can “hallucinate a lot and are very confident in their answers, which can be misleading,” potentially producing incorrect code or contradictory advice.

3. Martingale-like Strategies: Strategies assisted by LLMs can lead to “Martingale-like” behaviours that appear to have a high win rate by not closing losing trades, leading to accumulating “floating P&L” and the risk of wiping out the entire account in a single trade.

4. Data Quality and Cost: Relying on free data can lead to inaccuracies, and obtaining high-quality, granular data can be expensive, impacting the reliability of AI models. Thorough research is essential for selecting reliable data sources and evaluating trading strategies to ensure robust performance.

5. Numerical Reasoning Gap: LLMs currently exhibit deficiencies in precisely recognising price-volume patterns compared to specialised quant DL models.

6. Oversimplified Portfolio Optimisation: Current LLM frameworks often neglect sophisticated risk measures and assume frictionless markets.

7. Operational Limitations in Order Execution: Most LLM systems assume perfect liquidity, ignoring complex order book dynamics and market impact.

In summary, while AI offers significant potential for enhancing profitability through advanced analysis and automation in trading, its successful application requires careful consideration of its inherent limitations and risks, especially concerning overfitting and the reliability of LLM outputs.

“The ChatGPT and related GPT technology will probably be advanced to a state where discretionary trading might be more profitable by the agent!” - Dr. Ernie Chan, March 2024, Panel Discussion on AI Powered Trading

Therefore, to potentially make money with AI trading, an individual would need:

• Clear Trade Ideas: The ability to conceptualise a trading strategy, even if coding knowledge is minimal.
• Effective Prompt Engineering: Skill in crafting precise prompts for LLMs to generate desired code or analysis.
• Critical Evaluation and Verification: Crucially, the ability to critically review AI-generated code and results for errors, inconsistencies, and potential risks (like overfitting or Martingale-like behaviour). This involves understanding basic trading concepts and common pitfalls.
• Patience and Continuous Refinement: The process often involves “a nightmare of ups and downs,” requiring perseverance to “get everything set up correctly” and to “constantly keep checking/reminding your AI to stay on track”.

Free course on Introduction to Machine Learning in Trading

While AI tools like LLMs can lower the barrier to entry by assisting with coding, a solid understanding of Python remains highly beneficial for greater control, customisation, and the ability to diagnose and refine sophisticated trading systems, which is crucial when putting significant capital at risk. Brokers play a key role in enabling automated trading and connecting AI tools to the markets through their APIs and trading platforms.

"If you are doing this in practice, you want to be very, very good at programming... You need to be able to code very, very quickly and well" - Paul Bilokon, Sept 2024, Workshop on Reinforcement Learning

How QuantInsti's courses cover ML and AI

The EPAT (Executive Programme in Algorithmic Trading) curriculum makes a significant contribution to education on AI for trading by providing a comprehensive, practical, and industry-relevant pathway.

• Comprehensive Curriculum Structure and Content: EPAT is a fully online live classroom course offering over 120 hours of live training and approximately 150 hours of self-study content. Accredited by the Institute of Banking and Finance (IBF, Singapore) and Continuing Professional Development, UK, it aims to make algorithmic trading accessible to individuals from diverse backgrounds, focusing on both theoretical knowledge and practical application using real-world data and case studies. EPAT lectures are led by experts and practitioners who help students generate and refine their own trading ideas using practical insights and real-world applications.
• Specific Modules on AI: The curriculum covers key modules directly relevant to AI for trading:
• Machine Learning for Trading (Module 7): This central module equips participants to apply AI, particularly machine learning, in developing and implementing robust trading strategies. It covers:
• Foundations: Use of Python and Jupyter notebooks for feature creation, model building/evaluation, and performance testing, emphasising understanding of overfitting.
• Core Machine Learning Algorithms: Supervised Learning (Classification: predicting market direction, regression: predicting continuous values), including Decision Trees, Random Forests, Logistic Regression, and Support Vector Machines (SVM). Unsupervised Learning, such as clustering (e.g., K-Means for grouping assets). Neural Networks: Architecture, activation functions, training techniques (gradient descent, backpropagation).
• Natural Language Processing (NLP) and Sentiment Analysis: Highlights alternative data (news, social media), covering text preprocessing, vectorization techniques (Term Frequency, TF-IDF, Word2vec), Topic Modelling (LSA, LDA), and using Machine Readable News (MRN) for sentiment analysis in trading.
• Reinforcement Learning (RL) for Trading: Introduces RL where an agent learns optimal actions by maximising a reward signal, explaining deep RL to approximate Q-tables and emphasising reward function design and state feature selection. It also addresses RL limitations, such as overfitting and hyperparameter complexity.
• Statistical Arbitrage with PCA: Explores strategies using Principal Component Analysis (PCA) for dimensionality reduction, understanding abstract factors, and generalising strategies to portfolios.
• Data Analysis & Modelling in Python (Module 6): Focuses on practical Python skills, working with market data of different asset classes.
• Advanced Statistics for Quant Strategies (Module 9): Covers time series analysis.
• Portfolio Optimisation & Risk Management (Module 11): Crucial for balancing risk and return, covering risk types, industry-standard techniques (VaR, stress testing), risk-adjusted return metrics, and capital allocation.
• Market Microstructure for Trading (Module 4): Essential for high-frequency trading (HFT) roles, covering market mechanisms, order book dynamics, order types, algorithms, implementation shortfalls, and execution strategies to minimise costs.

Conclusion

In conclusion, while commercial applications offer automated AI tools, QuantInsti provides a comprehensive educational pathway. It teaches the underlying AI methodologies (machine learning, deep learning, NLP, reinforcement learning), quantitative finance principles, statistical foundations, and practical programming skills required to build, understand, and advance sophisticated trading systems.

EPAT effectively bridges the gap between theoretical AI research and its practical deployment in the financial industry, enabling participants to contribute to the "forefront" of AI application in quantitative investment by understanding how AI can be used for tasks such as data mining, sentiment analysis, real-time analysis, predictive modelling, risk modelling, stress testing, backtesting, and benchmarking in trading.

Explore the entire EPAT curriculum or schedule a free counselling call to ask your questions: