I saw an article somewhere the other day that suggested that even really good Machine Learning candidates were failing to get good jobs.

Apparently the universities are now churning out many ML graduates … but the jobs are surprisingly not there.

The article suggested that the top users of AI have decided to build very small teams of stellar AI gurus : geniuses with multiple PhDs. The firms do NOT want hoards of simply ‘very good’ ML candidates.

Is this likely to be true?

If so, is it just the top firms which are this fussy? In which case, are there other firms who are happy to hire the ‘good’ ML candidates?

Model is tacotron2 based on this repo.

So, I made it work with Pytorch DDP, and it works, but the gap between single and distributed train seems to me too large.

Loss single GPU vs 8 GPU

So, single GPU loss much better, stable and 8 GPUs give only x2 time gain with x8 costs.

Do I miss something obvious?

Maybe because of batchnorm? Tried sync batch norm, but it does not really make a difference.

https://github.com/JeiKeiLim/simple_distribute_job

I posted earlier that I have built a face detector to blur faces for videos. It was so slow that it takes about 10 hours per each video and I have 160 videos to process….. Which takes about more than two months.

I don’t think I can wait for that long. Thankfully, I have a few machines to run in parallel. And Managing which videos has been done processing which is not and merging all videos to one computer seems too much work.

So I made a simple management job management program for multiple servers to do undone work and upload the resulting video to the main server once it is finished.

Then I realized it could be used for machine learning training on multiple machines or experimentations. I know there are good distributed job management systems but it looks like it requires to install too much. All I needed was a simple job scheduler.

I’m posting this hoping someone finds this useful.

Thank you!

BTW, I’ve been running this with blurring faces on video for 2 days and it still says it will be done in 15 days. So.. I got that going for me which is nice

Hi everyone,

So over the last several weeks, for research I’m doing at my university, I’ve been tasked with working on some ML problems that fall in the domain of NLP. As a result of the all the reading I’ve been doing to gain some familiarity with NLP, I had this realization that I had gotten very jaded to machine learning as a discipline, totally forgetting that the thing that first motivated me to begin down this path was my desire to work on the engineering challenge of creating AGI.

Now that I’ve begun thinking about this again, I am curious as to how many people are actually out there working on this problem? There are a lot of data scientist or hobbyist who build predictive models using ML, but who are the people who are using ML as a tool specifically for engineering AGI?

For those of you out there, I have the following questions.

1. In what capacity have you worked on this problem and how did you get your start?

2. For how long have you been working on this and what have been your key takeaways from your experience thus far? These could philosophical insights, challenges, or general thoughts.

3. When an AGI is created, do you think machine learning will be a key component in it’s creation, a small piece, or do you think the technology we need to create it will be fundamentally different than what we currently think of now as machine learning?

Lastly, if you have any recommendations for research papers myself and others might find interesting, please share.

I wondering what the state of the art is (and if there’s available open source software) to take a list of facts / sentence fragments and form a reasonable paragraph from them. For instance, if one wanted to take a list of subject-predictate-object triples and have a chat-bot express them as text, how would I do it? I’m familiar with libraries like SimpleNLG but this seems a bit archaic. Is there better open-source software available, or good paper’s I should check-out?

Our results are documented here https://www.thebipartisanpress.com/politics/calculating-political-bias-and-fighting-partisanship-with-ai/

We used FastAI with Hugging face’s transformers library in probably the first regression approach to this task.

As expected, we found RoBERTa to provide a much more accurate prediction when fine-tuned compared to BERT, which had a much higher accuracy compared to ULMFit trained on wikitext-103.

We also attempted to use xlnet as well as Albert, but the later yielded poor results, and curiously, we weren’t able to fit even xlnet-base on a V100(16gb) with a sequence length of 512 and batch size of 1, even with fp16.

We created a tool that people can try out here: https://www.thebipartisanpress.com/analyze-bias/

Repository: https://github.com/LemonPi/pytorch_mppi

I made a pytorch implementation of the algorithm from Information theoretic MPC for model-based reinforcement learning that should be a better drop-in for MPC if you’re using random shooting or the cross entropy method (CEM)

Some features – batch sampling of trajectories (optionally on the GPU) – general to problem dimension – only requires approximate dynamics, which can be implemented as a network (MPPI originally requires sampling from the true dynamics, but this formulation uses importance sampling)

Hello!

I’m currently a second year university student in France, in an institute technology (mainly focused on CS and not so much on Math), and i really want to study Machine Learning/Deep Learning and get into research but as i said my actual degree lack of theoretical skills such as math, so i can’t get into most of the schools because they are very selective.

So i am kinda lost and am looking for universities to start all over again. Is there any universities in Europe/Outside of Europe (Canada) that would let me study what i want? I would prefer if it’s close to France and if it’s an english/french speaking country.

I know that there is some good schools such as Polytechnique in France but there is no way i could get into them with my actual degree, and i would need to do a math degree before joining it but the education system won’t let me get into those since i already spent 1.5 year studying after my highschool degree. That’s why i am looking for opportunities abroad.

I would prefer universities that i can afford easily but i will take any suggestions that you have! As i said i also don’t mind starting all over again, i prefer to “waste” 2 years and study something that i really like that continuing to study something that i don’t really like as much as AI.

Hi,

I couldn’t find a post where I could find all such resources in a single place so I am making this one.