深度学习直观-阿里云

【深度学习】5-从计算图直观认识“激活函数不以零为中心导致收敛变慢”

1. 收敛变慢的原因先上计算图（某层神经网络的一小部分）：图中黑色箭头为正向推理，红色箭头为误差的反向传播。因为 s i g m o i d sigmoidsigmoid 函数的输出值都为正，故x i x_ix i 的符号都相同且为正；则参数 w i w_iw i 的更新方向...

深度学习热点|超直观无公式图解Contrastive Predictive Coding从脸盲说起（二）

【重点来了】那么怎么对比学习呢？理想来说，你是一个阅剧无数的人，那么从这个电视剧后面的真实剧情的感情走向和你预测的感情走向应该是极为相似的。如果此时有人谈到另一个电视剧 (你看的电视剧叫 ) 的感情走向 ,那你一定能判断出他在谈的不是你在看的电视剧可是如果你是一个小孩（初始化的神经网络，你可能...

高校精品课-复旦大学-机器学习与深度学习

1 课时 |

105 人已学 |

加入学习

深度学习框架TensorFlow入门

24 课时 |

17302 人已学 |

加入学习

深度学习与自动驾驶

12 课时 |

3062 人已学 |

加入学习

深度学习热点|超直观无公式图解Contrastive Predictive Coding从脸盲说起（一）

Contrastive Learning (对比学习) 是这两年深度学习非常热的话题，可以说是刷新了很多人对无监督学习对认知。最初谷歌写的Representation Learning with Contrastive Predictive Coding (CPC) 公式十分抽象，不好理解。我在做完...

共有3条

< 1 >

跳转至： GO

更新时间 2024-02-14 10:21:20

本页面内关键词为智能算法引擎基于机器学习所生成，如有任何问题，可在页面下方点击"联系我们"与我们沟通。

产品推荐

{"optioninfo":{"dynamic":"ture","static":"true"},"simplifiedDisplay":"newEdition","newCard":[{"ifIcon":"img","link":"https://img.alicdn.com/tfs/TB1XY8hGYr1gK0jSZFDXXb9yVXa-1740-328.png","icon":"ModelScope 魔搭社区","iconImg":"https://img.alicdn.com/imgextra/i3/O1CN01WCQZsb1ICYCctdAi1_!!6000000000857-55-tps-240-240.svg","contentLink":"https://modelscope.cn","title":"ModelScope 魔搭社区","des":"为实现“模型即服务”理念，魔搭社区提供最新最热、开放开源的多领域预训练模型和优质数据集，让广大开发者无需写代码就能快速体验模型效果；同时提供抽象编程接口及SDK，对模型进行二次开发，真正让模型应用到不同的场景中。","link1":"https://modelscope.cn","btn1":"社区详情","link2":"https://modelscope.cn/docs","btn2":"文档中心","btn3":"","link3":"","infoGroup":[{"infoName":"立即体验","infoContent":{"firstContentName":"模型库","firstContentLink":"https://modelscope.cn/models","lastContentName":"数据集","lastContentLink":"https://modelscope.cn/datasets"}},{"infoName":"热门活动","infoContent":{"firstContentName":"社区 VIP 招募激励计划","firstContentLink":"https://modelscope.cn/activitys/kol"}}]}],"card":[],"search":[],"infoCard":[{"bannerUrl":"https://img.alicdn.com/imgextra/i3/O1CN01WCQZsb1ICYCctdAi1_!!6000000000857-55-tps-240-240.svg","bannerTitle":"智能计算灵骏","bannerContent":"智能计算灵骏是阿里云自主研发的新一代智能计算产品，提供深度优化的异构计算融合集群实例，满足人工智能、大数据、高性能计算等多种应用场景。","liveButtonName":"查看详情","liveButtonLink":"https://www.aliyun.com/product/ai/lingjun","contentTitle":"","homePageLink":"https://help.aliyun.com/document_detail/444430.html","homePageName":"产品文档","linkGroup":[]}],"title":{"mainTitle":"","subtitle":"","linkUrl":"","btnText":""},"visual":{"topbg":"https://img.alicdn.com/tfs/TB1bQuBIYH1gK0jSZFwXXc7aXXa-3840-740.gif","icon":"https://img.alicdn.com/imgextra/i3/O1CN01WCQZsb1ICYCctdAi1_!!6000000000857-55-tps-240-240.svg","textColor":"dark"},"dataList":[],"sceneCard":[],"txt":[]}

{"$env":{"JSON":{}},"$page":{"env":"production"},"$context":{"optioninfo":{"dynamic":"ture","static":"true"},"simplifiedDisplay":"newEdition","newCard":[{"ifIcon":"img","link":"https://img.alicdn.com/tfs/TB1XY8hGYr1gK0jSZFDXXb9yVXa-1740-328.png","icon":"ModelScope 魔搭社区","iconImg":"https://img.alicdn.com/imgextra/i3/O1CN01WCQZsb1ICYCctdAi1_!!6000000000857-55-tps-240-240.svg","contentLink":"https://modelscope.cn","title":"ModelScope 魔搭社区","des":"为实现“模型即服务”理念，魔搭社区提供最新最热、开放开源的多领域预训练模型和优质数据集，让广大开发者无需写代码就能快速体验模型效果；同时提供抽象编程接口及SDK，对模型进行二次开发，真正让模型应用到不同的场景中。","link1":"https://modelscope.cn","btn1":"社区详情","link2":"https://modelscope.cn/docs","btn2":"文档中心","btn3":"","link3":"","infoGroup":[{"infoName":"立即体验","infoContent":{"firstContentName":"模型库","firstContentLink":"https://modelscope.cn/models","lastContentName":"数据集","lastContentLink":"https://modelscope.cn/datasets"}},{"infoName":"热门活动","infoContent":{"firstContentName":"社区 VIP 招募激励计划","firstContentLink":"https://modelscope.cn/activitys/kol"}}]}],"card":[],"search":[],"infoCard":[{"bannerUrl":"https://img.alicdn.com/imgextra/i3/O1CN01WCQZsb1ICYCctdAi1_!!6000000000857-55-tps-240-240.svg","bannerTitle":"智能计算灵骏","bannerContent":"智能计算灵骏是阿里云自主研发的新一代智能计算产品，提供深度优化的异构计算融合集群实例，满足人工智能、大数据、高性能计算等多种应用场景。","liveButtonName":"查看详情","liveButtonLink":"https://www.aliyun.com/product/ai/lingjun","contentTitle":"","homePageLink":"https://help.aliyun.com/document_detail/444430.html","homePageName":"产品文档","linkGroup":[]}],"title":{"mainTitle":"","subtitle":"","linkUrl":"","btnText":""},"visual":{"topbg":"https://img.alicdn.com/tfs/TB1bQuBIYH1gK0jSZFwXXc7aXXa-3840-740.gif","icon":"https://img.alicdn.com/imgextra/i3/O1CN01WCQZsb1ICYCctdAi1_!!6000000000857-55-tps-240-240.svg","textColor":"dark"},"dataList":[],"sceneCard":[],"txt":[]}}