I'm interested in a sub-field of AI but don't know what to call it.

post by fowlertm · 2019-08-25T14:55:13.028Z · LW · GW · 2 comments

This is a question post.

Contents

  Answers
    1 waveman
None
2 comments

A colleague of mine and I have recently decided to tackle a project which we think has important ramifications for the field of artificial intelligence. We're vaguely aware that relevant work has been done at places like Carnegie Mellon and are hoping to get some guidance.

Our two overarching goals are to discover how models are constructed and to develop a model 'calculus' describing how an agent searches the space of possible hypotheses. We want to examine these questions from a number of different perspectives, studying the means by which both human and artificial agents actually arrive at models that allow them to understand the world, as well as the ways in which they would do so were they performing optimally.

Our motivation is to probe the subtle interchange between inductive and deductive reasoning. When is it that an agent moves from merely noticing patterns in data to reasoning on the basis of an axiomatic, deductive, predictive theory? Does it work differently in different domains? Do these inflection points have common characteristics, and, if so, can we use them to form a general theory of theories?

Does this framing even make any sense?

Along the way we hope to address a number of ancillary questions. Perhaps we can arrive at a formal theory of models, or probe the similarities and differences in how artificial intelligences and humans approach the task of compressing data down into simpler representations. There are obvious connections to Thomas Kuhn, to David Hume's is/ought problem, and to vast swathes of the philosophy of science.

We'd like help locating important books, seminal papers, good overview materials, words or phrases we can Google, theorists that have pushed the field forward, anything like that.

Thank you.

Answers

answer by waveman · 2019-08-25T22:56:07.050Z · LW(p) · GW(p)

Data Analysis Using Regression and Multilevel/Hierarchical Models has some material about deciding between models on this though pretty low level.

Looking at my bookshelf most general AI/ML books have starting points.

"Pattern Recognition and Machine Learning" Bishop

"Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference" Pearl

"Probabilistic Graphical Models: Principles and Techniques" Koller

This is a super-hard problem but worth tackling.



comment by fowlertm · 2019-08-26T11:50:37.904Z · LW(p) · GW(p)

Thanks for the recommendations. One thing that would is just knowing what this is called. Do your books give it a name?

2 comments

Comments sorted by top scores.

comment by FactorialCode · 2019-08-25T17:20:33.308Z · LW(p) · GW(p)

Can you list some papers that are vaguely in line with the kind of research you're looking for?

Replies from: fowlertm
comment by fowlertm · 2019-08-25T20:17:01.603Z · LW(p) · GW(p)

Not yet. That's part of what we're hoping to learn about here.