[OT]输入法联想原理？
110 views
Skip to first unread message
包乾
Jul 18, 2016, 4:02:48 AM7/18/16
to sh...@googlegroups.com
最近很热的苹果手机"击沉XX"输入法联想，这种联想是不是词库里自动匹配出来的？词库匹配一般是人为一个一个做出来的，还是什么算法自动搞出来的？
单纯好奇一下
Shell Xu
Jul 18, 2016, 4:47:24 AM7/18/16
to shlug
如果是我来做，大概会分词语料，做前后关联度分析。
当然，这种喂语料的方法有的时候往往弄出来一些啼笑皆非的联想。例如你喂他一篇说中国体操如何如何NB的语料。然后试试：
中国队？
大败
？！怎么会是大败？
回去看语料。发现一堆这个：
X年X月，中国队大败XX队。。。
X年X月，中国队大败XX队凯旋。。。
当然，这种喂语料的方法有的时候往往弄出来一些啼笑皆非的联想。例如你喂他一篇说中国体操如何如何NB的语料。然后试试：
中国队？
大败
？！怎么会是大败？
回去看语料。发现一堆这个：
X年X月，中国队大败XX队。。。
X年X月，中国队大败XX队凯旋。。。
2016-07-18 16:02 GMT+08:00 包乾 <houke...@gmail.com>:
最近很热的苹果手机"击沉XX"输入法联想，这种联想是不是词库里自动匹配出来的？词库匹配一般是人为一个一个做出来的，还是什么算法自动搞出来的？
单纯好奇一下
--
-- You received this message because you are subscribed to the Google Groups Shanghai Linux User Group group. To post to this group, send email to sh...@googlegroups.com. To unsubscribe from this group, send email to shlug+un...@googlegroups.com. For more options, visit this group at https://groups.google.com/d/forum/shlug?hl=zh-CN
---
您收到此邮件是因为您订阅了Google网上论坛上的“Shanghai Linux User Group”群组。
要退订此群组并停止接收此群组的电子邮件，请发送电子邮件到shlug+un...@googlegroups.com。
要查看更多选项，请访问https://groups.google.com/d/optout。
--
彼節者有間，而刀刃者無厚；以無厚入有間，恢恢乎其於游刃必有餘地矣。
blog: http://shell909090.org/
blog: http://shell909090.org/
Zoom.Quiet
Jul 18, 2016, 4:48:34 AM7/18/16
to shlug
基本上是就搜索时的提醒一个算法
俺: http://zoomquiet.io
授: http://creativecommons.org/licenses/by-sa/2.5/cn/
怒: 冗余不做,日子甭过!备份不做,十恶不赦!
KM keep growing environment culture which promoting organization be learnning!
> 最近很热的苹果手机"击沉XX"输入法联想，这种联想是不是词库里自动匹配出来的？词库匹配一般是人为一个一个做出来的，还是什么算法自动搞出来的？
> 单纯好奇一下
>
> 单纯好奇一下
>
> --
> -- You received this message because you are subscribed to the Google Groups
> Shanghai Linux User Group group. To post to this group, send email to
> sh...@googlegroups.com. To unsubscribe from this group, send email to
> shlug+un...@googlegroups.com. For more options, visit this group at
> https://groups.google.com/d/forum/shlug?hl=zh-CN
> ---
> 您收到此邮件是因为您订阅了Google网上论坛上的“Shanghai Linux User Group”群组。
> 要退订此群组并停止接收此群组的电子邮件，请发送电子邮件到shlug+un...@googlegroups.com。
> 要查看更多选项，请访问https://groups.google.com/d/optout。
--
life is pathetic, go Pythonic! 人生苦短, Python当歌!
> -- You received this message because you are subscribed to the Google Groups
> Shanghai Linux User Group group. To post to this group, send email to
> sh...@googlegroups.com. To unsubscribe from this group, send email to
> shlug+un...@googlegroups.com. For more options, visit this group at
> https://groups.google.com/d/forum/shlug?hl=zh-CN
> ---
> 您收到此邮件是因为您订阅了Google网上论坛上的“Shanghai Linux User Group”群组。
> 要退订此群组并停止接收此群组的电子邮件，请发送电子邮件到shlug+un...@googlegroups.com。
> 要查看更多选项，请访问https://groups.google.com/d/optout。
--
俺: http://zoomquiet.io
授: http://creativecommons.org/licenses/by-sa/2.5/cn/
怒: 冗余不做,日子甭过!备份不做,十恶不赦!
KM keep growing environment culture which promoting organization be learnning!
包乾
Jul 18, 2016, 5:34:24 AM7/18/16
to sh...@googlegroups.com
有业内同学告诉我的确是爬来信息然后进行training的做法比较主流。
大量用户长期输入击沉中国这个组合的可能性毕竟不大。
Shell Xu
Jul 18, 2016, 6:06:24 AM7/18/16
to shlug
爬信息做语料一定要预鉴别和最后人工确认的。不然你输入这时十有。。。
联想自动提示你“十有**”。
联想自动提示你“十有**”。
Chaos Eternal
Jul 18, 2016, 6:40:08 AM7/18/16
to shlug
把马尔科夫模型的深度做深一点嘛。
Shell Xu
Jul 19, 2016, 3:12:14 AM7/19/16
to shlug
一个是算起来慢，另一个是效果可能快速的打折扣。
Honglei Cong
Jul 22, 2016, 11:10:44 PM7/22/16
to sh...@googlegroups.com
模型训练好了，做成关联词库，用的时候就是查表的事情，后面就周期更新词库就行了？
包乾
Aug 6, 2016, 8:21:49 PM8/6/16
to sh...@googlegroups.com
这里有一个Markov Chain的视频：https://www.youtube.com/watch?v=56mGTszb_iM
模型训练好了，做成关联词库，用的时候就是查表的事情，后面就周期更新词库就行了？
一个是算起来慢，另一个是效果可能快速的打折扣。
把马尔科夫模型的深度做深一点嘛。
爬信息做语料一定要预鉴别和最后人工确认的。不然你输入这时十有。。。
联想自动提示你“十有**”。
有业内同学告诉我的确是爬来信息然后进行training的做法比较主流。
大量用户长期输入击沉中国这个组合的可能性毕竟不大。
--
-- You received this message because you are subscribed to the Google Groups Shanghai Linux User Group group. To post to this group, send email to sh...@googlegroups.com. To unsubscribe from this group, send email to shlug+unsubscribe@googlegroups.com. For more options, visit this group at https://groups.google.com/d/forum/shlug?hl=zh-CN
---
您收到此邮件是因为您订阅了Google网上论坛上的“Shanghai Linux User Group”群组。
要退订此群组并停止接收此群组的电子邮件，请发送电子邮件到shlug+unsubscribe@googlegroups.com。
要查看更多选项，请访问https://groups.google.com/d/optout。
--
-- You received this message because you are subscribed to the Google Groups Shanghai Linux User Group group. To post to this group, send email to sh...@googlegroups.com. To unsubscribe from this group, send email to shlug+unsubscribe@googlegroups.com. For more options, visit this group at https://groups.google.com/d/forum/shlug?hl=zh-CN
---
您收到此邮件是因为您订阅了Google网上论坛上的“Shanghai Linux User Group”群组。
--要退订此群组并停止接收此群组的电子邮件，请发送电子邮件到shlug+unsubscribe@googlegroups.com。
要查看更多选项，请访问https://groups.google.com/d/optout。
-- You received this message because you are subscribed to the Google Groups Shanghai Linux User Group group. To post to this group, send email to sh...@googlegroups.com. To unsubscribe from this group, send email to shlug+unsubscribe@googlegroups.com. For more options, visit this group at https://groups.google.com/d/forum/shlug?hl=zh-CN
---
您收到此邮件是因为您订阅了Google网上论坛上的“Shanghai Linux User Group”群组。
要退订此群组并停止接收此群组的电子邮件，请发送电子邮件到shlug+unsubscribe@googlegroups.com。
要查看更多选项，请访问https://groups.google.com/d/optout。
--
-- You received this message because you are subscribed to the Google Groups Shanghai Linux User Group group. To post to this group, send email to sh...@googlegroups.com. To unsubscribe from this group, send email to shlug+unsubscribe@googlegroups.com. For more options, visit this group at https://groups.google.com/d/forum/shlug?hl=zh-CN
---
您收到此邮件是因为您订阅了Google网上论坛上的“Shanghai Linux User Group”群组。
--要退订此群组并停止接收此群组的电子邮件，请发送电子邮件到shlug+unsubscribe@googlegroups.com。
要查看更多选项，请访问https://groups.google.com/d/optout。
-- You received this message because you are subscribed to the Google Groups Shanghai Linux User Group group. To post to this group, send email to sh...@googlegroups.com. To unsubscribe from this group, send email to shlug+unsubscribe@googlegroups.com. For more options, visit this group at https://groups.google.com/d/forum/shlug?hl=zh-CN
---
您收到此邮件是因为您订阅了Google网上论坛上的“Shanghai Linux User Group”群组。
要退订此群组并停止接收此群组的电子邮件，请发送电子邮件到shlug+unsubscribe@googlegroups.com。
要查看更多选项，请访问https://groups.google.com/d/optout。
--
-- You received this message because you are subscribed to the Google Groups Shanghai Linux User Group group. To post to this group, send email to sh...@googlegroups.com. To unsubscribe from this group, send email to shlug+unsubscribe@googlegroups.com. For more options, visit this group at https://groups.google.com/d/forum/shlug?hl=zh-CN
---
您收到此邮件是因为您订阅了Google网上论坛上的“Shanghai Linux User Group”群组。
--要退订此群组并停止接收此群组的电子邮件，请发送电子邮件到shlug+unsubscribe@googlegroups.com。
要查看更多选项，请访问https://groups.google.com/d/optout。
-- You received this message because you are subscribed to the Google Groups Shanghai Linux User Group group. To post to this group, send email to sh...@googlegroups.com. To unsubscribe from this group, send email to shlug+unsubscribe@googlegroups.com. For more options, visit this group at https://groups.google.com/d/forum/shlug?hl=zh-CN
---
您收到此邮件是因为您订阅了Google网上论坛上的“Shanghai Linux User Group”群组。
要退订此群组并停止接收此群组的电子邮件，请发送电子邮件到shlug+unsubscribe@googlegroups.com。
要查看更多选项，请访问https://groups.google.com/d/optout。
Reply all
Reply to author
Forward
0 new messages