Hello, new to ML and also not a very math-oriented person. I am creating a Discord bot that will be able to detect phishing links by using a decision tree (still need to figure out how to link the trained ML model to the bot).

The current accuracy of this program is 90% which seems pretty good on the surface but how can I tell if its *actually* 90%? I was reading about confusion matrixes and training via entropy, maybe either of those is good to use? Every run-through of the program the accuracy decreases. Why?

On the top line of my code you can see where I got my dataset which contains approximately 2000 instances. Is that enough? I found this dataset which contains 5000 instances https://data.mendeley.com/datasets/h3cgnj8hft/1 . Can I train the decision tree on more than one dataset? Is that a good idea? Should I combine both datasets into one?

Ultimately, what should be my next step(s)?

https://pastebin.com/XE0Ss9hq

From Scott Aaronson’s Shtetl-Optimized blog, an open email from Steve Pinker:

I appreciate your frank comments. At the same time, I do not agree with them. Please allow me to explain.

If this were a matter of sexual harassment or other hostile behavior toward women, I would of course support strong measures to combat it. Any member of the Symposium who uttered demeaning comments toward or about women certainly deserves censure.

But that is not what is at issue here. It’s an utterly irrelevant matter: the three-decades-old acronym for the Neural Information Processing Symposium, the pleasingly pronounceable NIPS. To state what should be obvious: nip is not a sexual word. As Chair of the Usage Panel of the American Heritage Dictionary, I can support this claim.

(And as my mother wrote to me: “I don’t get it. I thought Nips was a brand of caramel candy.”) [Indeed, I enjoyed those candies as a kid. –SA] Even if people with an adolescent mindset think of nipples when hearing the sound “nips,” the society should not endorse the idea that the concept of nipples is sexist. Men have nipples too, and women’s nipples evolved as organs of nursing, not sexual gratification. Indeed, many feminists have argued that it’s sexist to conceptualize women’s bodies from the point of view of male sexuality.

If some people make insulting puns that demean women, the society should condemn them for the insults, not concede to their puerility by endorsing their appropriation of an innocent sound. (The Linguistics Society of America and Boston Debate League do not change their names to disavow jejune clichés about cunning linguists and master debaters.) To act as if anything with the remotest connection to sexuality must be censored to protect delicate female sensibilities is insulting to women and reminiscent of prissy Victorian taboos against uncovered piano legs or the phrase “with the naked eye.”

Any harm to the community of computer scientists has been done not by me but by the pressure group and the Symposium’s surrender. As a public figure who hears from a broad range of people outside the academic bubble, I can tell you that this episode has not played well. It’s seen as the latest sign that academia has lost its mind—that it has traded reasoned argument, conceptual rigor, proportionality, and common sense for prudish censoriousness, snowflake sensibility, and virtue signaling. I often hear from intelligent non-leftists, “Why should I be impressed by the scientific consensus on climate change? Everyone knows that academics just fall into line with the politically correct position.” To secure the credibility of the academy, we have to make reasoned distinctions, and stop turning our enterprise into a laughingstock.

To repeat: none of this deprecates the important effort to stamp out harassment and misogyny in science, which I’m well aware of and thoroughly support, but which has nothing to do with the acronym NIPS.

You are welcome to share this note with interested parties.

Best,

Steve

As the title says, I’m curious as to what is the most efficient way to figure out if your idea is junk or your implementation messed up somewhere. Especially if your implementation failed due to strange autograd quirks of the framework you’re using (which has bit me in the past sometimes). I guess the common sense ones are:

• Test it on toy cases (takes a long time to design)
• Get advisor / someone else in the lab to take a look (often they agree with the general idea, but won’t have the inclination/time to study the implementation very deeply, understandably)
• Git gud (pretty hard)

Paper: https://arxiv.org/abs/1508.06576

This is an exciting paper because it’s the first to introduce artistic style transfer using pre-trained neural networks.

What’s great is how the paper demonstrated how to extract content (e.g., shapes, contours) from an image and how to extract style from multiple layers (e.g., some layers extract fine-grained styles while others extract overall style). Combining these techniques can yield realistic and professional results.

The main issue is timing and compute power required. The paper extracts content features of an image with VGG19 and extracts style features from multiple layers with VGG19. Because it requires extensive compute power for feature extraction and for optimizing style and content loss, it takes 500-1000 iterations just to produce a low-resolution image. It would be ideal if the algorithm could produce results in a few iterations.

1. Has anybody tried RESNET or any other state of the art network instead of VGG19?
2. Does anyone know of a transformer network that produces similar results to this paper?
3. Any recommendations on better style transfer papers?

Does anyone have any good papers that would be worth checking out for mining causal relationships? In particular with continuous variables and high dimensionality data sets.

LeCun tweeted here: https://twitter.com/ylecun/status/1209497021398343680?s=20, about what is the real definition of DL as he said “Some folks still seem confused about what deep learning is. Here is a definition: DL is constructing networks of parameterized functional modules & training them from examples using gradient-based optimization”

I think he is pointing to Gary Marques’debate with Bengio, and it seems controversial discussion over the thread, I don’t know what do you think about LeCun statement about DL definition.

At the risk of sounding like I’m wearing a tinfoil hat, I’d like to vent regarding how messed up I think it is that most dating apps lack transparency when it comes to their match-making algorithms.

Before I jump in, let me just start by saying that a large percentage of dating takes place online these days. Therefore, anyone who wants to argue that we should all just meet in person can kindly frick off because you’re missing the point of this post.

My reasoning is as follows:

1. How a dating algorithm functions will directly impact one’s chance of successfully finding a mate.
2. Whether or not you can find a good mate will have a huge impact on your overall quality of life, mental health, financial success, etc.
3. The ability to alter an algorithm to selectively favor or disfavor certain populations chance at successful mating via tweeking of a few lines of code is a unique superpower never before unleashed upon the world.
4. Setting aside any notions of bad actors purposely inhibiting your ability to get laid (which who knows… maybe that could happen), isn’t it at all concerning that this mega-powerful ability has close to zero public oversight?

And yes, I’ll have to admit that part of the reason I am making this post is that I honestly feel like I might have been shadowbanned on Tinder for reasons that are unclear to me. It’s just a hunch of course, but it seems bizarre how much my match rate has decreased over the past couple of years. I’m bothered that I have no insight into why this might be. Maybe I’m only allowed to date people in my economic circle (i.e. poor) with the rest of the undesirables. Maybe I haven’t posted on Reddit enough in the past. Dunno.

I’d love to hear others’ thoughts on this matter.