Skip to main content

Blog

Learn About Our Meetup

5000+ Members

MEETUPS

LEARN, CONNECT, SHARE

Join our meetup, learn, connect, share, and get to know your Toronto AI community. 

JOB POSTINGS

INDEED POSTINGS

Browse through the latest deep learning, ai, machine learning postings from Indeed for the GTA.

CONTACT

CONNECT WITH US

Are you looking to sponsor space, be a speaker, or volunteer, feel free to give us a shout.

Author: torontoai

[D] Machine Learning – WAYR (What Are You Reading) – Week 65

This is a place to share machine learning research papers, journals, and articles that you’re reading this week. If it relates to what you’re researching, by all means elaborate and give us your insight, otherwise it could just be an interesting paper you’ve read.

Please try to provide some insight from your understanding and please don’t post things which are present in wiki.

Preferably you should link the arxiv page (not the PDF, you can easily access the PDF from the summary page but not the other way around) or any other pertinent links.

Previous weeks :

1-10 11-20 21-30 31-40 41-50 51-60 61-70
Week 1 Week 11 Week 21 Week 31 Week 41 Week 51 Week 61
Week 2 Week 12 Week 22 Week 32 Week 42 Week 52 Week 62
Week 3 Week 13 Week 23 Week 33 Week 43 Week 53 Week 63
Week 4 Week 14 Week 24 Week 34 Week 44 Week 54 Week 64
Week 5 Week 15 Week 25 Week 35 Week 45 Week 55
Week 6 Week 16 Week 26 Week 36 Week 46 Week 56
Week 7 Week 17 Week 27 Week 37 Week 47 Week 57
Week 8 Week 18 Week 28 Week 38 Week 48 Week 58
Week 9 Week 19 Week 29 Week 39 Week 49 Week 59
Week 10 Week 20 Week 30 Week 40 Week 50 Week 60

Most upvoted papers two weeks ago:

/u/CrippledEye: https://arxiv.org/abs/1905.01723

/u/mitare: https://weightagnostic.github.io/

/u/veranceftw: MelNet: A Generative Model for Audio in the Frequency Domain

Besides that, there are no rules, have fun.

submitted by /u/ML_WAYR_bot
[link] [comments]

[P] Writing mission statement for project related to machine learning for catalyst design.

Hey all!

I am starting my first scientific job after my PhD in Physics, as a research scientist this summer in Beijing for a project related to catalyst design. I am very excited to be part of this project. I am starting to write out the scope of the project. Let me know any tips or advice you may have.

Many fields in Physics and Chemistry utilize the Schrodinger Equation or Density Functional Theory to compute various properties and insights into the systems under study. Any computational natural scientist will know that in practice the starting point for many of these calculations, in other words what is fed as input into the machine are the atomic numbers and geometries.

Two Approaches

  • (a) Can machine learning help discover new insights and physics into the systems of interest- From knowledge of just the molecular structures of the atoms are we able to acquire any insight into more efficient and less harmful combustion reactions that utilize catalysts? In a more broader sense this may give insight into the computational quantum mechanical approach.

  • (b) The inverse design problem deals with the prediction of novel undiscovered molecules.

Methodology

These two problems have the opposite approaches: in case (a) we move from a known chemical space towards prediction of physical and chemical quantum properties, whereas in the second case we would like to start from a desired property to make predictions about the chemical space.

To approach question (a) the work uses quantum mechanical data to undergo supervised learning methods which have been shown to perform generally on the same scale as models that utilize unsupervised (for e.g. convulutional neural networks).
No theoretical methods exist to explore all combinatorially possible alloyed systems. ( for the smallest known thiolated nanocluster, Au_15 (SR)_13 there would be over 32k possibilities which presents a significant computational challenge to characterize all potential structures)[1]

The overall problem of catalyst design from a brute force machine learning method would therefore be to have stacks or layers of features and predictions starting from knowledge of just the geometry and atomic numbers of the molecular structures.

(b) The inverse design problem revolves around finding the best chemical structures with desired properties. One could utilize invertible models from machine learning such as generative models (GANs, autoencoders).
According to Kulik et al. [2] only a tiny fraction (1 part in 1050) of chemical space has ever been explored. This necessitates the need for machine learning approach rather than design each molecular system by hand (either experimentally or computationally). A great review paper that provides insight into how the inverse design problem may be approached was written by B. Sanchez-Lengeling and Alan Aspuru-Guzik [3]. One could begin unsupervised learning starting from databases of potential catalysts.

[1] Machine-Learning Prediction CO Adsorption in Thiolated, Ag- Alloyed Au Nanoclusters, J. Am. Chem. Soc. 2018, James P. Lewis et al.

[2] Designing in the Face of Uncertainty: Exploiting Electronic Structure and Machine Learning Models for Discovery, Inorganic Chemistry, Inorg. Chem. 2019, H. Kulik et al.

[3] Inverse Molecular Design using Machine Learning: Generative models for matter engineering, Science 2018, B.Sanchez-Lengeling and Alan Aspuru-Guzik.

submitted by /u/schizophrenicman123
[link] [comments]

[D] I tried to plot 6D data using pseudo dimensions in Python

After many attempts to visualize and intuitively understand data, I came up with an idea to use pseudo dimensions for plotting 4D, 5D..6D data. I used different colors, size and shapes for adding pseudo dimensions. Although it isn’t a true dimensional representation, it provides fairly good intuition about data.

I used plot.ly for drawing plots.

Here’s the article link: https://link.medium.com/iaHQMM8gVX

Repo: https://github.com/ostwalprasad/PythonMultiDimensionalPlots

submitted by /u/prasadostwal
[link] [comments]

[D] As a Non CS undergrad looking to get internships in ML or AI in the summer of 2020, what are the skills / projects that I would need to acquire before hand

At the end of the 6th semester, I’ll have to do an internship as part of my coursework. I would like to get one in the field of ML or AI.

I have attended a few courses on ML and have a grasp of the math and theoretical concepts involved. But I have not worked on any projects where I have used machine learning algorithms.

I would prefer to work under a professor at a university for this intern and I guess I’ll need to have good amount of experience in order to do so. So what kind of experience would be useful in this case?

submitted by /u/shivakanthsujit
[link] [comments]

[D] Best way to label/prepare data for full-body gesture recognition.

Sorry, I’m pretty much a newbie to this kind of things. Long story short, I have a pose data obtained from Openpose and I want to recognize certain gestures using LSTM-RNN. A gesture would be N consecutive poses obtained from camera. Some of the gestures: walking, sweeping, idling, bringing object.

Training-wise it’s pretty much not a problem acquiring 98% on training set and 90%+ on test set. Data wise also shouldn’t be a problem since I have over millions of poses already (the day I realized Google Sheet cells limit is too small LOL). But implementing it on my real-time data always shows how bad it’s. Making me thinking it’s learning the wrong kind of features.

What I’ve done:

  • With no pre-processing at all, I separated the poses into 4 regions: NE, NW, SE, SW (as in “north-east”, etc) which basically means the poses happening in 4 very diff locations on the image. Result: The LSTM isn’t even correctly recognizing the separated region consistently, let alone the certain gestures.

  • Amplifying the real distance between the 4 regions, by giving them a large offset if a certain boundary is passed. Again, same result.

  • Normalizing all of the poses to origin. This way no translation info is present on the data (inference & training). Yet, even after simplifying the data for two classes, it’s still so bad.

  • Normalizing only the first poses of a gesture to origin, and the last N-1 poses would start moving from origin (to preserve translation data). Even worse that previous iteration on test set, giving 85%.

At this point, I’m afraid I’m doing something fundamentally wrong with my data. What I worried about are:

  • I divide my gestures into regions instead of the direction it’s going.

  • The model just isn’t cut for it.

  • The movement from the noise is way too big compared to the actual gesture.

I humbly ask for any assistance at this point LOL.

submitted by /u/ArsenicBismuth
[link] [comments]

[Project] Use ML in Politics – make your math matter :)

Tech and product team looking to start an AI based project with potential of turning into a startup. Looking for a data scientist partner who: – is passionate about politics and civics ( doesn’t matter if you’re left or right) – dynamic and driven and can commit time – ML experience a must ; NLP preferred – Boston or east coast based preferably – can work part of a team – is fun to be around!

Let us know!!! We want to talk to you.

submitted by /u/sorinadrianr
[link] [comments]

[R] Multilevel Modelling of U.S. Home Loan Data

This is an example of multilevel modelling in R, which is necessary when data is split across different categories or hierarchies. Specifically, we can see how this can model mortgage risk (in terms of the loan to value ratio) across different U.S. states.

Any opinions or feedback welcome.

Link: https://www.michael-grogan.com/mortgage-multilevel/

submitted by /u/plentyofnodes
[link] [comments]