A universal subhAShita database.

[विश्वासो वासुकिजः (Vishvas Vasuki)]

Here's a head's up about a forthcoming project (extracted from README.md) - For now, I request this list to pay close attention to the technical choices and point out mistakes and alternatives :

Goal

We've set out to build a database of subhAShita​ -s which is:

• Universal
  • Its goal is to contain within it every worthy subhAShita ever composed.
  • In fact, the ambition encompasses all languages, verse and prose forms.
• Freely and easily available. Anyone should be able to
  • Access it
  • Export it in other formats
  • Present it in any way users will find convenient.
    • Eg. the upcoming [subhAShita-pratimAlA] app project.
• Growing constantly in number
  • sarasvatI still suckles some amongst us at her bosom!
• Growing constantly in annotations/ ratings
• add annotations (rating, description, translations, metre, flaws, sources ...)

Technical choices

• Use Nosql rather than a relational database as the primary canonical database.
  • Reasons (from here ):
    • The need to develop with agility
      • Simplicity (less need to join n tables)
      • Flexibility (schema can easily be changed)
    • distributed nature: ability to operate at any scale.
      • Database copies can sync with each other easily - no centralization is good.
  • Current favorite : Couchbase database, since it can be used in many mobile OS-s.
• Scala for the ingestion libraries (same justification as expressed here ).

[विश्वासो वासुकिजः (Vishvas Vasuki)]

One of the quandaries I have:
* Would it be possible to host such a database reliably & fast somewhere for free or are we stuck with just publishing a non-live periodically updated copy.

--

--
Vishvas /विश्वासः

[Vasu Srinivasan]

vishvAsa varya

uttamA yojanA ArabdhA | mayaa api saahayyam kartum shakyate, yataH ciraad asmin viShayee (kaschana bRhat subhAShita sangrahaH) aashaktiH mama |

havent thought of alternatives yet (but will do), but some "use cases" could be:

- api based approach

- keywords search, both unicode and ascii/multiple translit schemes

about hosting:

- AWS or similar cloud service ?

Regards,
Vasu Srinivasan
-----------------------------------
vagartham.wordpress.com
vasya10.wordpress.com

--
You received this message because you are subscribed to the Google Groups "sanskrit-programmers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sanskrit-programmers+unsub...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[विश्वासो वासुकिजः (Vishvas Vasuki)]

2017-03-26 5:42 GMT-07:00 Vasu Srinivasan <vas...@gmail.com>:

mayaa api saahayyam kartum shakyate, yataH ciraad asmin viShayee (kaschana bRhat subhAShita sangrahaH) aashaktiH mama |

अहो

​ शोभनम्! आयातु भवान् अपि। भावत्कं गिट्-हब्-नाम किम्?​

 

havent thought of alternatives yet (but will do), but some "use cases" could be:

- api based approach

​web-api ननु? ​

शोभनो

​ विचारः। तदप्यस्तु।​

 

- keywords search, both unicode and ascii/multiple translit schemes

​not just that, subhAShita-s should be disambiguated for spaces, anusvAra-s, daNDa-s, avagraha-s​, sandhi-s

[Ramanathan Sharma]

We have to simplify things as much as possible. Why not have all the subhashitas in markdown files within the repo and use HTML/JS page to display in a word formatted way in a Github page. Everything is free and open source! They can text search subhashitas and Google will index it too so anyone Googling can also come there. 

[विश्वासो वासुकिजः (Vishvas Vasuki)]

2017-04-25 11:18 GMT-07:00 Ramanathan Sharma <heyram...@gmail.com>:

Why not have all the subhashitas in markdown files within the repo and use HTML/JS page to display in a word formatted way in a Github page. Everything is free and open source! They can text search subhashitas and Google will index it too so anyone Googling can also come there. 

​Oh be my guest! That already exists. We don't intend to type new subhashitas from books one by one (atleast not now).​ See the 10k+ here https://github.com/sanskrit-coders/subhAShita-db-sanskrit/tree/master/mUlAni (and there is lots more not present there online).

​But, we're ​not satisfied with that due to reasons stated in the README file, which I reproduce below:

Motivation

• One of the greatest (and useful) pleasures I've had in tough times is retreat for a while into the world of beautiful subhAShita-s - and then burst back out like the vRtraghna armed with dadhIchi's bones.
• I especially like online collections curated by some friends and myself:
  • since a book is not always available, and
  • I want to collect + easily access choice ones for future enjoyment.
• But it is tedious (atleast for me) to sit in front of a computer to do the following:
  • read them,
  • or scour the internet for new ones
  • or collect favorites in a spreadsheet
  • or just annotate them with comments.
• So, it is desirable to:
  • make the above as simple and easy as possible,
  • and to share our collective labor so that we can benefit more easily from each others' work.

 

[विश्वासो वासुकिजः (Vishvas Vasuki)]

Summarized current state of this at https://github.com/subhAShita/subhAShita.github.io/raw/master/static/articles/wsc2022/subhAShita-db-deduplication.pdf .

[विश्वासो वासुकिजः (Vishvas Vasuki)]

(slight correction in url - https://github.com/subhAShita/subhAShita.github.io/raw/master/static/articles/intro2022/subhAShita-db-deduplication.pdf )