On 9/27/2022 6:34 PM, rbowman wrote:
> On 9/27/22 08:30, DFS wrote:
>> On 9/26/2022 9:48 PM, rbowman wrote:
>>> On 9/26/22 09:43, DFS wrote:
>>>>
>>>> Or writing my own little version of SQLite (dbms).
>>>
>>> Please don't. A programmer who left for greener pastures a long time
>>> ago gifted us with 'sdb'. I'm not sure if that's supposed to be
>>> Simple Database or Shitty Database. To frost the cake it is in C++,
>>> uses the Microsoft unique classes, and exhibits the worst of
>>> Hungarian notation and other M$ stylistic quirks.
>>
>>
https://fileinfo.com/extension/sbd
>>
>> Was his db released to the public?
>
> No, and the public can be thankful. It smells a bit like dBase III
> without a decent interface.
>
>> SQLite being the best of the small ones, in my estimation, because
>> it's file-based and extremely easy to install and use. And the
>> documentation is very good. And it's free. And it's extremely
>> stable. And has very large capacities.
>
> I've heard good things about it and I think one of our programmers is
> going to use it. He had been using the SQL Express LocalDb for user/role
> configurations. While SQL Express is available on Linux LocalDb isn't.
SQLiteStudio or HeidiSQL (more advanced and featureful) are nice tools
for working with SQLite dbs.
>> Popularity ranking sites:
>>
db-engines.com
>>
https://pypl.github.io/DB.html
>
> I don't think much by ranking by Google searches. Obviously Oracle is
> heavily weighted by searches starting with 'how do I do X with this
> overpriced piece of crap?' My impression is Oracle is chiefly supported
> by our tax dollars at work.
Oracle is definitely overpriced, and their salespeople and client mgrs
are apparently aggressive in finding ways to squeeze money from their
customers. I worked with Oracle a fair amt at work off and on, and it's
the dbms I would choose if money were no object.
Nice comparo grid here
https://www.g2.com/categories/relational-databases#grid
You can click on the entries and read reviews of each.
> I've been working with Postgres lately. The price is right.
Last fall, in addition to SQLite, I installed Postgres, MariaDB,
FireBird, Oracle Express and DB2 Express.
In each one I created clones of my SQLite master Usenet database. Then
I installed python connector utilities:
conn = psycopg2.connect(user='DFS', password='**', dbname='USENET')
conn = cx_Oracle.connect(user="DFS",password="**",",dsn="XE")
etc
Then I wrote bulk insert code to copy the data from SQLite to each of them.
# Table Sort Column BulkInsertFactor
#load these tables in any order
tbls = []
tbls += [ "charset", "CHARSETID", 3 ]
tbls += [ "messageid", "MSGID", 5000 ]
tbls += [ "months", "MONTH_NBR", 2 ]
tbls += [ "nntp_group", "GROUPID", 100 ]
tbls += [ "nntp_server", "SERVERID", 1 ]
tbls += [ "subject", "SUBJECTID", 1000 ]
tbls += [ "useragent", "USERAGENTID", 500 ]
#load these tables in this order
tbls += [ "postername", "POSTERNAMEID", 10 ]
tbls += [ "posternamegroup", "POSTERNAMEID", 100 ]
tbls += [ "poster", "POSTERID", 1000 ]
tbls += [ "post", "POSTID", 5000 ]
#load these tables in any order
tbls += [ "postbody", "POSTID", 100 ]
tbls += [ "postdate", "POSTID", 1000 ]
tbls += [ "newsgroups", "POSTID", 5000 ]
tbls += [ "reference", "POSTID", 10000 ]
for i in range(0,len(tbls)-1,3):
tblname = tbls[i].upper()
tblsort = tbls[i+1]
bulkins = tbls[i+2]
copydata(dbtype, tblname, tblsort, bulkins, psym)
print("%.2f secs to post %d rows " % (time.perf_counter() - startMaster,
totrows))
Played around with the 'bulk insert factor' to squeeze out the best data
load performance, which overall was Oracle - on an old PC I got 200K
inserts per second on some tables. Incredible.
> If you look
> at AWS SQL Server instances be prepared to send them your left nut.
> That's not Amazon -- that's M$ per core licensing and the number of
> processors and RAM you need. Pricing is very complex so don't take the
> numbers literally but a base bones Server 2019 might run you 32 cents
> and hour. Add SQL Server and it's more like 2 dollars an hour.
Cheaper than licenses and DBAs, probably.
> A bare bones Linux instance is more like 11 cents an hour.
Yeah, you don't have to pay those broke FOSS devs who gave all their
code away to GuhNoo.
> I haven't looked at other cloud providers but I assume the proportions
> are similar. The cloud won't do much for desktop Linux but it makes
> Linux servers very attractive.
Linux works best as a dumb host for files and databases.