Let me know what you think, my first attempt at applying machine learning and I am not an expert. I took advantage of an existing replay application, which I extended to overlay predictions. http://pubgmachinelearning.com

The “Machine Learning” link on the page will show my process, I would love to hear from more knowledgeable people how it can be improved.

Hi,

I was a big fan of Medium few years ago. However, I have noticed that it contains a lot of noise recently. I am trying to refresh my list of blogs that I follow, the idea is to focus on blogs that features advanced ML topics such distill.pub, thegradient.pub, ruder.io, Kapathy blog. Some labs blogs such bair berkeley, facebook, google AI, openai, deepmind. In addition to r/MachineLearning, which blogs do you usually follow?

For those who are interested about engineering blogs, this is a good list of engineering blogst

ODSC India is looking for speakers for the 2020 conference in Bengaluru, India. If you’ve got an innovative application or cutting edge insights into Machine Learning, you should check it out. It’s a great way to engage with the community and share your knowledge! Proposal submissions close on October 9. https://confng.in/ySfDg6gX

Conference Focus Areas:

• AI for Engineers
• Open Data Science
• Data Visualization
• Machine Learning & Deep Learning
• Data Science at Scale
• Data Science Kick Start
• Math Behind AI
• Data Management
• DataOps

Conference dates: 16-19 September, 2020

[News]

Hi guys,

I’d like to share another PyTorch related project some of you (hopefully) will find helpful and interesting. Here is GitHub repository and here is documentation.

Also, if you have any suggestions/improvements/questions for this project I will be glad to answer/help, thanks.

Now, description (taken from project’s readme with minor adjustments):

What is it?

torchfunc is library revolving around PyTorch with a goal to help you with:

• Improving and analysing performance of your neural network (e.g. Tensor Cores compatibility)
• Record/analyse internal state of torch.nn.Module as data passes through it
• Do the above based on external conditions (using single Callable to specify it)
• Day-to-day neural network related duties (model size, seeding, performance measurements etc.)
• Get information about your host operating system, CUDA devices and others

Quick examples

Get instant performance tips about your module. All problems described by comments will be shown by torchfunc.performance.tips:

class Model(torch.nn.Module): def __init__(self): super().__init__() self.convolution = torch.nn.Sequential( torch.nn.Conv2d(1, 32, 3), torch.nn.ReLU(inplace=True), # Inplace may harm kernel fusion torch.nn.Conv2d(32, 128, 3, groups=32), # Depthwise is slower in PyTorch torch.nn.ReLU(inplace=True), # Same as before torch.nn.Conv2d(128, 250, 3), # Wrong output size for TensorCores ) self.classifier = torch.nn.Sequential( torch.nn.Linear(250, 64), # Wrong input size for TensorCores torch.nn.ReLU(), # Fine, no info about this layer torch.nn.Linear(64, 10), # Wrong output size for TensorCores ) def forward(self, inputs): convolved = torch.nn.AdaptiveAvgPool2d(1)(self.convolution(inputs)).flatten() return self.classifier(convolved) # All you have to do print(torchfunc.performance.tips(Model())) 

Seed globaly (including numpy and cuda), freeze weights, check inference time and model size:

# Inb4 MNIST, you can use any module with those functions model = torch.nn.Linear(784, 10) torchfunc.seed(0) frozen = torchfunc.module.freeze(model, bias=False) with torchfunc.Timer() as timer: frozen(torch.randn(32, 784) print(timer.checkpoint()) # Time since the beginning frozen(torch.randn(128, 784) print(timer.checkpoint()) # Since last checkpoint print(f"Overall time {timer}; Model size: {torchfunc.sizeof(frozen)}") 

Record and sum per-layer and per-neuron activation statistics as data passes through network:

# Still MNIST but any module can be put in it's place model = torch.nn.Sequential( torch.nn.Linear(784, 100), torch.nn.ReLU(), torch.nn.Linear(100, 50), torch.nn.ReLU(), torch.nn.Linear(50, 10), ) # Recorder which sums all inputs to layers recorder = torchfunc.hooks.recorders.ForwardPre(reduction=lambda x, y: x+y) # Record only for torch.nn.Linear recorder.children(model, types=(torch.nn.Linear,)) # Train your network normally (or pass data through it) ... # Activations of all neurons of first layer! print(recorder[1]) # You can also post-process this data easily with apply 

Installation

pip

Latest release:

pip install --user torchfunc

Nightly:

pip install --user torchfunc-nightly

One could also check the project out with Docker, see more info in README as this post is getting long I guess

BTW. There is also another project of mine torchdata revolving around data processing with PyTorch, might be of interest to some of you as well (it was announced one week ago here as well, but in case you missed).