Installation

[Tania Zaman]

Hi,

I've been trying to install gall 0.5.  In the install.txt, lines 34/35 mentions that one should register a twitter account through 

http://mooduniversity.com/test/twitterdatamining/reg/

-- But I get 404 error trying to do it.

Thanks,

[Tania Zaman]

Never mind. Figured it out.

--
-- Tania

[Tania Zaman]

disregard

[Argenis Leon]

Hi tanina,

This was and error in the install doc. You need to go to YOURDOMAIN/twitterdatamining/reg/ and select the private option.

Hope this help

On Fri, Jun 29, 2012 at 2:34 PM, Tania Zaman <taniaz...@gmail.com> wrote:

--

Ing. Argenis Leon, Dr.
Maracaibo, Venezuela
Movil: (58)414-6124547

[Tania Zaman]

Yeah, I figured.  Thanks, Argenis.

I have another issue - the app is not retrieving any Twitter data. 

-- Tania

--
-- Tania

[Tania Zaman]

I have a feeling that it has something to do with the server time setup and timezone-related code in gall.  What items should be in sync inside the cofiguration settings?  A check with serverDate.php reveals that the server timezone represents EST in USA.

--
-- Tania

[Argenis Leon]

Hi Tania,

Could I have access to the cpanel?. It would be great if I could verify the installation by my own.

[Tania Zaman]

Hi Argenis,

See if this helps.  Thanks in advance

Here is a portion of the error_log ---

 

[02-Jul-2012 17:12:41] PHP Warning: mysql_data_seek() [<a href='function.mysql-data-seek'>function.mysql-data-seek</a>]: Offset 0 is invalid for MySQL result index 6 (or the query data is unbuffered) in /home2/converg8/public_html/gall/twitterdatamining/retrieve/totalfriendsjson-a.php on line 97 [02-Jul-2012 17:12:41] PHP Warning: mysql_data_seek() [<a href='function.mysql-data-seek'>function.mysql-data-seek</a>]: Offset 0 is invalid for MySQL result index 6 (or the query data is unbuffered) in /home2/converg8/public_html/gall/twitterdatamining/retrieve/totaltweetsjson-a.php on line 112 [02-Jul-2012 17:12:42] PHP Warning: mysql_data_seek() [<a href='function.mysql-data-seek'>function.mysql-data-seek</a>]: Offset 0 is invalid for MySQL result index 6 (or the query data is unbuffered) in /home2/converg8/public_html/gall/twitterdatamining/retrieve/totalmentionsjson-a.php on line 99

-----
And a Cron mail -- 

Cron Daemon ro...@host365.hostmonster.com	4:00 PM (1 hour ago)
to me

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:01 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:02 --:--:--     0
100   282    0   282    0     0    108      0 --:--:--  0:00:02 --:--:--   108
<div> Getting data from Twitter API from TaniaLZaman</div><div>Getting ReTweets...</div><div>Error getting retweets401</div><div>Done!!</div><div> Getting data from Twitter API from convergeorg</div><div>Getting ReTweets...</div><div>Error getting retweets401</div><div>Done!!</div>

----

From the cron report, I can see there is a problem with Authentication/Authorization with the Twitter account.

--
-- Tania

[Argenis Leon]

Ji tania,

It seems that the account you add to gall is not propertly authenticated. You need to go to the gall registration page and add your account as a private account. You need to have the twitter account user and pass.

Please let me know if you have another issue

[Tania Zaman]

Yup - that was my thought too and did that earlier today.  

Thanks for your response.

-- Tania

--
-- Tania

[Argenis Leon]

Is gall working now?

[Tania Zaman]

hmm..no...

Here is the latest Cron mail

Cron Daemon ro...@host365.hostmonster.com	1:00 PM (29 minutes ago)
to me

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0

  0     0    0     0    0     0      0      0 --:--:--  0:00:01 --:--:--     0

  0     0    0     0    0     0      0      0 --:--:--  0:00:02 --:--:--     0

  0     0    0     0    0     0      0      0 --:--:--  0:00:03 --:--:--     0
100   370    0   370    0     0    102      0 --:--:--  0:00:03 --:--:--   103
100   370    0   370    0     0    102      0 --:--:--  0:00:03 --:--:--   102

<div> Getting data from Twitter API from TaniaLZaman</div>Not Sync done yet.Not idSync available for this accountNot Sync done yet.Not idSync available for this account<div>Done!!</div><div> Getting data from Twitter API from convergeorg</div>Not Sync done yet.Not idSync available for this accountNot Sync done yet.Not idSync available for this account<div>Done!!</div>

----

--
-- Tania

[Argenis Leon]

Ok make  forgot to include this cron in the documentation

0 0 * * 0 curl 'YOUR_PATH_HERE/twitterdatamining/retrieve/twitter.php?get=usersData&id=all&list=true'.

Then run from your browser

'YOUR_PATH_HERE/twitterdatamining/retrieve/twitter.php?get=usersData&id=all&list=true'

then

YOUR_PATH_HERE/twitterdatamining/retrieve/twitter.php?get=usersData&id=all&usersData=true

So you fill the database with friends/followers info.

Please letme know if this works. 

[Tania Zaman]

Ok Argenis, it is closer, but totally.  the database is being filled up with NULLs.  Here is a part of the sql dump 

-

INSERT INTO `friends_data` (`id`, `id_sync`, `date_sync`, `screen_name`, `name`, `description`, `location`, `created_at`, `statuses_count`, `friends_count`, `followers_count`, `verified`, `protected`, `updated`, `lang`, `source`, `time_zone`, `followed`, `default_profile_image`, `last_status_date`) VALUES

('14848921', 1, '2012-07-03 20:24:02', NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, 0, '', '', '', 'TaniaLZaman', '', '0000-00-00 00:00:00'),

('22506375', 2, '2012-07-03 20:24:03', NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, 0, '', '', '', 'convergeorg', '', '0000-00-00 00:00:00'),

('51263711', 2, '2012-07-03 20:24:03', NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, 0, '', '', '', 'convergeorg', '', '0000-00-00 00:00:00'),

('27081981', 2, '2012-07-03 20:24:03', NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, 0, '', '', '', 'convergeorg', '', '0000-00-00 00:00:00'),

('14458280', 2, '2012-07-03 20:24:03', NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, 0, '', '', '', 'convergeorg', '', '0000-00-00 00:00:00'),

('13062772', 2, '2012-07-03 20:24:03', NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, 0, '', '', '', 'convergeorg', '', '0000-00-00 00:00:00'),

('402870048', 2, '2012-07-03 20:24:03', NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, 0, '', '', '', 'convergeorg', '', '0000-00-00 00:00:00'),

('34373370', 2, '2012-07-03 20:24:03', NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, 0, '', '', '', 'convergeorg', '', '0000-00-00 00:00:00'),

('67719573', 2, '2012-07-03 20:24:03', NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, 0, '', '', '', 'convergeorg', '', '0000-00-00 00:00:00'),

('22642027', 2, '2012-07-03 20:24:03', NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, 0, '', '', '', 'convergeorg', '', '0000-00-00 00:00:00'),

--
-- Tania

[Argenis Leon]

Hi Tanian,

Try to run YOUR_PATH_HERE/twitterdatamining/retrieve/twitter.php?get=usersData&id=all&usersData=true

This must fill NULL values with the data. You can put &debug=true to see more debug information.

[Tania Zaman]

Hi Argenis,

Here is the problem right now - 

With   - <>/ twitterdatamining/retrieve/twitter.php?get=usersData&id=all&usersData=true, I get Not ip available for both followers and friends.

I have one ip address.  Do I need to have another ip address for friends and followers to be recorded in the database?

The other issue is that the script becomes runaway and unresponsive..

-- Tania

--
-- Tania

[Argenis Leon]

Hi Tania,

You can use the same ip for both process.  Goto 'request_ip' table and put your ip in the field 'ip' and the number '2' in 'ip_group'.

The script become unresponsibe because it take so long to finish. To see whats happening use &debug=true and the end of the url. For exmaple  "twitterdatamining/retrieve/twitter.php?get=usersData&id=all&usersData=true&debug=true"

Hope this help

[Tania Zaman]

Thanks for your reply.

I had tried it before, but the ip field is a primary key in the table and does not allow dupes.  However I took away the index and tried it out.

I had also tried out the debug route, but nothing significant comes out. I get the same error message.

Tania

--
-- Tania

[Argenis Leon]

Hi Tania,

Should no be primary key in the ip table. If exist please remove it

Please run this script

/twitterdatamining/utils/reset_ip_request.php

This should get the informacino from twitter about how much request you have available a put it in the database.

Then run

/twitterdatamining/retrieve/getipavailables.php

And you should see the request numbers availables.You should have between 150 and 350 request.

Can you send me your ip address i could check the rate limit for you?!

[scooter vineburgh]

Hi Argenis,

I work with Tania and will be participating in the conversation.

Our IP address is 66.147.240.165

I appreciate your help with this and really love the application so far.

Thanks,

James

Hope this help

-- Tania

-

Cron Daemon root@host365.hostmonster.com

to me

Is gall working now?

-- Tania

Cron Daemon root@host365.hostmonster.com

to me

--
-- Tania

--
-- Tania

--
-- Tania

--
-- Tania

--
-- Tania

[scooter vineburgh]

Alos, the application is installed at http://convergeconsulting.org/gall/

Thanks again,

James

[Argenis Leon]

Hi James,

I am investigating the issue. I will response back as soon as possible.

[scooter vineburgh]

Excellent - thanks!