answersLogoWhite

0

AllQ&AStudy Guides
Best answer

In machine learning, entropic loss is a specific kind of loss function. A loss function measures the error between the predicted results and the desired results. Entropic loss uses the logistic function to show the error (or "loss") between the true answer and the predicted answer.

A general loss function is defined here:

Lφ= ∫ (φ(z) - y)dz, where the bounds of the integral are φ-1(y) (on the bottom) and φ-1(yhat) (on the top). yhat is the estimated (predicted) result, and y is the desired result.

The entropic loss function is defined here:

Lφ= ∫ (1/(1 + exp(-z)) - y)dz

As you can see, the entropic loss is a specific instance of a loss function. All I've done is I've chosen my loss function φ(z) to be the logistic function.

The logistic function is a common choice because it is a convex function, and therefore has only one local minimum (therefore it is also the global minimum). When we try to minimize loss, we want only one minimum so that when we set the derivative to zero, we know we've found what we want.

This answer is:
Related answers

In machine learning, entropic loss is a specific kind of loss function. A loss function measures the error between the predicted results and the desired results. Entropic loss uses the logistic function to show the error (or "loss") between the true answer and the predicted answer.

A general loss function is defined here:

Lφ= ∫ (φ(z) - y)dz, where the bounds of the integral are φ-1(y) (on the bottom) and φ-1(yhat) (on the top). yhat is the estimated (predicted) result, and y is the desired result.

The entropic loss function is defined here:

Lφ= ∫ (1/(1 + exp(-z)) - y)dz

As you can see, the entropic loss is a specific instance of a loss function. All I've done is I've chosen my loss function φ(z) to be the logistic function.

The logistic function is a common choice because it is a convex function, and therefore has only one local minimum (therefore it is also the global minimum). When we try to minimize loss, we want only one minimum so that when we set the derivative to zero, we know we've found what we want.

View page

What would cause loss of motor function in upper thighs

View page

This granules...prevents water loss and energy loss. It is a water repellent.

View page

no

View page

to stop the loss of blood by clotting

View page
Featured study guide

What is a lysosome

What is sense of belonging

How do capillaries help control the amount of heat lost from the body

Sign of fracture

➑️
See all cards
3.0
β˜†β˜…β˜†β˜…β˜†β˜…β˜†β˜…β˜†β˜…
3 Reviews
More study guides
5.0
β˜†β˜…β˜†β˜…β˜†β˜…β˜†β˜…β˜†β˜…
1 Review

4.0
β˜†β˜…β˜†β˜…β˜†β˜…β˜†β˜…β˜†β˜…
2 Reviews
Search results