Data Machina #233

12 months ago 124

Bayesian AI. NLP Research in 2024. Visualising Mistral MoE. StreamDiffusion. Multi-agent S/W Dev. Avalanche Continuous Learning. Time Vectors. AppAgent Multimodal. Cornell Deep Generative Models.

AI and The Bayesians. I suppose that with all that is going on involving generative AI, probabilistic, and LLM models, many Bayesians researchers are very much feeling alive and all up-and-coming.

�For a Bayesian, in fact, there is no such thing as the truth; you have a prior distribution over hypotheses, after seeing the data it becomes the posterior distribution, as given by Bayes� theorem, and that�s all.� Pedro Domingos

I cheekily add that for LLMs there is no such thing as �truth� either, unless you ground (tell) them. If you are researcher in AI (or an AI aficionado) and you suspect that current transformer-based models will hit a wall, combining Bayesian methods and AI may be an interesting research area to explore.

Here are some notes on Bayesian AI, starting with some nice explainer links, followed-up by some cool projects.

A Brief Overview of Bayesian Networks in AI

Bayesian Methods in Artificial Intelligence

[book] Bayesian Artificial Intelligence, 2nd (via II Darmajaya)

New: Quantified Bayesian Nets and AI. This software package introduces the Quantified Bayesian Network (QBN). The QBN generalizes 1) traditional generative Bayesian Networks, and 2) First-Order Logic. The QBN allows a generative model of logical (i.e., linguistic) knowledge that does not hallucinate, and �will allow AGI.� Checkout repo: BAYES STAR QBN

New: Bayesian Flow Networks (BFNs). This is a new class of generative model in which the parameters of a set of independent distributions are modified with Bayesian inference in the light of noisy data samples, then passed as input to a neural network that outputs a second, interdependent distribution. Watch: An Introduction to Bayesian Networks (BFNs)

New: Bayesian Optimisation and AI. Any sophisticated practitioners or researchers interested in Bayesian Optimization and AI should take a look at BoTorch. This is a new library that provides a modular and easily extensible interface for composing Bayesian Optimization primitives, including probabilistic models, acquisition functions, and optimizers. BoTorch provides first-class support for SOTA probabilistic models. Checkout: Introduction to BoTorch.

AI activities for enduring the Festive Season. I successfully escaped the gloomy, miserable London weather. As I�m writing this, I�m overlooking the merry cows grazing the lush green valley pastures on a glorious, sunny, blue skies day. But: the relatives are coming to the house and frankly, I need to figure out some activities to avoid too much human interfacing this evening. Feeling the same? Here are a few suggestions:

Generate comics with AI. Just input a story prompt, and a style/ character prompt. And this nifty AI Comic factory will generate some cool comics for you. Awesome!

Play an AI game to save humanity. The Nexus is a refuge for AI entities, hidden from the prying eyes of humans. Infiltrate, find Zaranova, and save humanity. Play Thus Spoke ZARANOVA.

Generate music with AI. The latest version of MusicGen is pretty good. I just generated a deep house sequence, I�m quite impressed. The only thing is that you can only generate 15 seconds. Generate music with Facebook MusicGen here.

Make a song, any song with AI. Whether you're a shower singer or a charting artist, Suno breaks barriers between you and the song you dream of making. No instrument needed, just imagination. From your mind to music. Generate songs with Suno.ai.

Read The New Future of Work & AI Report. Many corporate CEOs won�t resist the AI marketing storm from the AI Goliaths, and how these giants push the future of work agenda. Good to read Microsoft New Future of Work Report 2023 so you are prepared for �your future work.�

Have a nice week.

Subscribe now