Project

General

Profile

Activity

From 09/18/2016 to 10/17/2016

10/18/2016

10:45 PM Bug #78: A routing failure causes gdplogd to become non-responsive.
Just a status update/record-keeping: As far as I can tell, this bug was introduced by commit:b39dd5f8. Nitesh Mor
09:34 PM Bug #78 (In Progress): A routing failure causes gdplogd to become non-responsive.
Nitesh Mor
09:33 PM Bug #78 (Closed): A routing failure causes gdplogd to become non-responsive.
If a client with subscriptions goes away, `gdplogd` gets a `NAK_R_NOROUTE` when attempting to deliver the data. Howev... Nitesh Mor
09:39 PM Bug #74: Asyn Write/Subscribe
Ali, can you please report back whether this fix for stuck subscriptions works for you? Nitesh Mor
09:34 PM Bug #77: GDP Log Server Crashes when we end subscription
A more accurate description of the problem in #78 Nitesh Mor
09:28 PM Bug #77: GDP Log Server Crashes when we end subscription
Yes, I can reproduce it now. What I see different in your logs that I didn't see earlier on my side was a NAK_R_NOROU... Nitesh Mor

10/17/2016

04:30 PM Bug #77: GDP Log Server Crashes when we end subscription
just checking if you were able to reproduce it? Syed Hasnain
03:26 PM Bug #77 (In Progress): GDP Log Server Crashes when we end subscription
Nitesh Mor
01:51 PM Bug #77: GDP Log Server Crashes when we end subscription
gdplogd was updated to latest commit. I still see the problem. The gdp-reader is also the latest commit. gdp-writer ... Syed Hasnain
11:30 AM Bug #77: GDP Log Server Crashes when we end subscription
Yes I did, the log for gdplogd confirms that It is using the latest commit. However, the problem seems to be there. L... Syed Hasnain
11:17 AM Bug #77: GDP Log Server Crashes when we end subscription
Just checking in: did updating to the latest version of code solve your issue? Nitesh Mor
05:54 PM Bug #77: GDP Log Server Crashes when we end subscription
Ok, let us try one more time. At least it is now running with higher debug setting. Could you run the following?
`...
Nitesh Mor
05:22 PM Bug #77: GDP Log Server Crashes when we end subscription
It doesn't seem to work. Even after doing that it seems I am running the server still at commit
```
2016-10-17 00...
Syed Hasnain
05:04 PM Bug #77: GDP Log Server Crashes when we end subscription
Let's try updating the log-server one more time. Assuming you are in the top directory of gdp source, can you do the ... Nitesh Mor

10/16/2016

04:48 PM Bug #77: GDP Log Server Crashes when we end subscription
Ok that might be the problem. The client side on our swarmboxes seem to be updated.
For gdp-reader
```
_gdp_lib_...
Syed Hasnain
04:26 PM Bug #77: GDP Log Server Crashes when we end subscription
I just saw the `gdplogd.log` file in #76. You are definitely running an older version of log-server (git commit `2023... Nitesh Mor
04:20 PM Bug #77: GDP Log Server Crashes when we end subscription
If you are running version 0.4.0, that would be severely outdated. Since you are running from the source code, a git ... Nitesh Mor
03:46 PM Bug #77: GDP Log Server Crashes when we end subscription

1. If the release notes are correct it seems I am running release 0.4.0. However I did a pull from repo earlier tod...
Syed Hasnain
03:10 PM Bug #77: GDP Log Server Crashes when we end subscription
I am sorry, you have to be more specific. It is most certainly an annoying bug, but I can not reproduce it as it is.
...
Nitesh Mor
02:49 PM Bug #77 (Closed): GDP Log Server Crashes when we end subscription
If we end the gdp-reader process after subscribing to log using ctrl+c, the log server/GDP stops working. If multipl... Syed Hasnain
04:30 PM Bug #76: ERROR: request freed while in use
Your log-server is still running with a `-D *=10` parameter, which is not nearly enough information for me to figure ... Nitesh Mor
04:00 PM Bug #76: ERROR: request freed while in use
I have attached the log for gdplog as well as gdp-router-click-log. Thank you for all the help. Syed Hasnain
03:28 PM Bug #76: ERROR: request freed while in use
Can you please post the debug log from the log-server (`/var/log/gdp/gdplogd.log`)? It appears that the client can no... Nitesh Mor
03:01 PM Bug #76: ERROR: request freed while in use
The following is debug information after the GDP crash happened. The crash has reported in #77 was caused by another ... Syed Hasnain
11:15 PM Bug #76: ERROR: request freed while in use
I can not seem to reproduce this bug. It would be helpful to see some more debugging information. Could you please do... Nitesh Mor
07:16 PM Bug #76 (Closed): ERROR: request freed while in use
The Local GDP seems to be crashing a lot. I see same errors as in bug #69 .
```
sbuser@swarmnuc015:~$ gdp-reader ...
Syed Hasnain
10:59 PM Bug #58 (Closed): 403 forbidden errors for many consecutive asynchronous writes (15 bytes @ 100 Hz)
Marking this closed for now, I can not seem to reproduce this.
If the issue persists, please reopen.
Nitesh Mor
10:57 PM Support #72: gcl-create hangs intermittently.
It seems more like an infrastructure related issue, than a bug. If you encounter this again, could you please include... Nitesh Mor
10:49 PM Bug #74 (Feedback): Asyn Write/Subscribe
Nitesh Mor
10:48 PM Bug #74: Asyn Write/Subscribe
I believe this is an issue related to subscriptions, rather than mode of append (synchronous vs asynchronous). More s... Nitesh Mor
10:35 PM Bug #75 (Feedback): Subscription times out
Hopefully fixed in commit:7bf6e9b2. It is a server side bug, and still needs to be deployed to production infrastruct... Nitesh Mor
07:03 PM Bug #75 (In Progress): Subscription times out
I have been able to narrow down the bug to subscription renewals in `gdplogd`.
Specifically, any post processing c...
Nitesh Mor

10/15/2016

03:57 PM Bug #75 (Closed): Subscription times out
As reported in #74, #55 and an email from Rico, it looks like there is a common bug, which is: subscriptions going aw... Nitesh Mor
02:52 PM Support #73: Can't write to log edu.berkeley.eecs.bid.mellis.arduino101
`gdplogd` on gdp-03 was messed up, I restarted it and it seems to work. What caused this, is still unknown.
One th...
Nitesh Mor
02:43 PM Feature #31 (Closed): Systemd debian packaging scripts for log-server
Nitesh Mor

10/14/2016

04:34 PM Bug #74: Asyn Write/Subscribe
> Incomplete PDU fd 8 pduLen 439 bufferDataLen 103
> Incomplete PDU fd 8 pduLen 441 bufferDataLen 157
> Incomplete ...
Eric Allman
03:42 PM Bug #74: Asyn Write/Subscribe
The log also contains records like the following for async writing
recno -1, len 0, ts 0
Syed Hasnain
03:40 PM Bug #74 (Closed): Asyn Write/Subscribe
If I write async to log, router log is filled with such messages:
Incomplete PDU fd 8 pduLen 439 bufferDataLen 103...
Syed Hasnain
03:35 PM Bug #69: Read, Write Errors
Nitesh Mor wrote:
> Edited description for readability.
Seeing this error on local GDP as well. Restarting the gd...
Syed Hasnain
01:02 PM Bug #64: gdplogd to gdp-router-click communications getting out of sync
gdplogd has been updated so that it doesn't complain if records arrive out of order. Unfortunately this also means t... Eric Allman
12:08 PM Support #73: Can't write to log edu.berkeley.eecs.bid.mellis.arduino101
Here's the debugging output, which includes an assertion failure and exit that I don't see when running without debug... David Mellis
12:03 PM Support #73 (Closed): Can't write to log edu.berkeley.eecs.bid.mellis.arduino101
When I run the following command:
~~~
./gdp-writer -a edu.berkeley.eecs.bid.mellis.arduino101
~~~
and enter l...
David Mellis
11:58 AM Support #72 (Closed): gcl-create hangs intermittently.
This was hanging for me, then started working again:
~~~
./gcl-create -C mellis@berkeley.edu edu.berkeley.eecs.bi...
David Mellis

10/13/2016

11:50 AM Bug #71 (Closed): Python shared library version mismatch
(On OS X)
When importing the Python library, I get
OSError: dlopen(/Volumes/code/berkeley/gdp/lang/python/gdp/../...
Pat Pannuto
10:53 AM Bug #70 (Closed): Makefiles do not respect environmental CFLAGS
Convention is to use CFLAGS += ... in Makefiles so that users can pass additional arguments via the command line. The... Pat Pannuto

10/09/2016

03:34 PM Bug #69: Read, Write Errors
Edited description for readability. Nitesh Mor
10:09 AM Bug #61: GDP Error 600
I just pulled gdp again and tried one more time.
**On my RPi:**
* It seems to be working, and it is logging this ...
Nima Mousavi

10/08/2016

03:20 PM Bug #69: Read, Write Errors
Hi Eric,
I thought I was running the latest gdp version, after cloning it from the repo, i will check again. Yes T...
Syed Hasnain
02:04 PM Bug #69 (In Progress): Read, Write Errors
As near as I can tell, the log server (gdplogd) is losing synchronization with the router layer under high load. I t... Eric Allman
03:12 PM Bug #57 (Closed): GDP Make Error
Eric Allman
03:11 PM Feature #63 (Closed): Refresh advertisements in gdplogd
Eric Allman

10/07/2016

03:26 PM Bug #61: GDP Error 600
The `gdplogd`s on gdp-01 and gdp-04 seem to have hung, hence the timeouts. It was hard to restart on both systems: ... Eric Allman
02:42 PM Bug #61: GDP Error 600
I am receiving a new error on my RPi (that was previously working).
I have attached the log for both systems. On swa...
Nima Mousavi
07:39 AM Bug #61: GDP Error 600
Assuming you have the regular client software installed, please capture the output of
gdp-reader -n 1 -D50 edu...
Eric Allman
07:29 PM Bug #61: GDP Error 600
I checked that parameter before. On RPi (which works) I have the following parameters set in /usr/local/etc/ep_adm_pa... Nima Mousavi
06:19 PM Bug #61: GDP Error 600
That looks like the client can't open a connection to the GDP router. This could be because of a network configurati... Eric Allman
05:33 PM Bug #61: GDP Error 600
Hi,
As far as I can see, error 600 is gone. I am able to run my codes on on one of my RPis (Ubuntu Mate) and I'm ye...
Nima Mousavi
01:15 PM Bug #69: Read, Write Errors

Getting this on trying to read now.
sbuser@swarmnuc015:~$ gdp-reader -t edu.tamu.watch1.test
Reading GCL tl0B...
Syed Hasnain
12:30 PM Bug #69 (Closed): Read, Write Errors
Get the following errors while trying to write or read to GDP , have successfully written and read these logs earlier... Syed Hasnain
08:13 AM Bug #64 (New): gdplogd to gdp-router-click communications getting out of sync
(It's not clear if this is a gdplogd or a gdp-router-click bug, but gdplogd is my first guess.)
Logs on gdp-01 see...
Eric Allman

10/06/2016

11:56 AM Bug #57: GDP Make Error
Thank you very much.
I've been trying to run on another RPi system (Ubuntu Mate OS) which seems to work for now. I'l...
Nima Mousavi
09:05 AM Bug #57 (Feedback): GDP Make Error
Nima, sorry, I never responded to your question. The most current list of packages is going to be in adm/gdp-setup.s... Eric Allman
08:51 AM Bug #61 (Feedback): GDP Error 600
Nima, please give it another try. I fixed a router bug late yesterday that might be the problem. Eric Allman
07:07 AM Bug #60: New GDP log created on log server inaccessible by gdp-reader.
I found a definite bug in the router code that caused log names to get mangled in some circumstances if they had zero... Eric Allman

10/04/2016

03:31 PM Bug #60 (In Progress): New GDP log created on log server inaccessible by gdp-reader.
Just to bring everyone up to date, I'm looking at this. The problem is clearly at the routing layer, so I'm moving t... Eric Allman
09:31 AM Bug #60: New GDP log created on log server inaccessible by gdp-reader.
FWIW - The Ptolemy II nightly build has been failing for a few days with ERROR: 600 no route available [Berkeley:Swar... Anonymous
06:02 PM Bug #55: GDP log subscribe hangs
The hanging issue was happening prior to the error 600. So they are separate issues.
There is data being added to ...
Nima Mousavi
05:29 PM Bug #55: GDP log subscribe hangs
Nima, can you clarify if the problem you are seeing is that your program hangs or gets a 600 error? The 600 error is... Eric Allman

10/03/2016

02:21 PM Feature #63 (Resolved): Refresh advertisements in gdplogd
This has been added in commit:67898fe7. This adds the `swarm.gdplogd.advertise.interval` parameter, which defaults t... Eric Allman
02:19 PM Feature #63 (Closed): Refresh advertisements in gdplogd
Advertisements for logs in `gdplogd` have not been refreshed, so if the routing layer "loses" a route it is never res... Eric Allman
10:18 AM Bug #61: GDP Error 600
I just tested whether I have access or not, and it seems like on some routers I receive error 600.
Is there anything...
Nima Mousavi

10/02/2016

02:50 PM Bug #61: GDP Error 600
To make things more problematic, the other log (`58jK2obVbOma7OwQNkgA7kuYqrEVcy4Tw5hMlREn5jY`) is only accessible by ... Eric Allman
02:31 PM Bug #61: GDP Error 600
Another update: it looks like the router on gdp-01 is the only router that doesn't know about that log, and restartin... Eric Allman
02:14 PM Bug #61: GDP Error 600
Eric Allman wrote:
> The problem is in the router. The log is hosted on gdp-03, and the router on gdp-03 knows abou...
Eric Allman
02:12 PM Bug #61: GDP Error 600
The problem is in the router. The log is hosted on gdp-03, and the router on gdp-03 knows about it, but that name ha... Eric Allman

09/30/2016

02:49 PM Bug #55: GDP log subscribe hangs
I tried it again and apparently now it was able to install using the bash script. I still had the same freezing issue... Nima Mousavi
08:49 AM Bug #55: GDP log subscribe hangs
Nima, commit:4770b39a should have fixed the libdb compile problem (sorry, I don't think I remembered to tell you that... Eric Allman
02:47 PM Bug #61 (Closed): GDP Error 600
I've been getting error 600 today when I try to create a gcl, or try to write to some of the logs that I created befo... Nima Mousavi
12:33 PM Bug #56 (Closed): Crash if isatty() returns true but TERM isn't set.
Eric Allman
12:28 PM Bug #58 (Feedback): 403 forbidden errors for many consecutive asynchronous writes (15 bytes @ 100...
David, the servers have been rebooted. If I'm right, this problem should be fixed. Please let me know. Eric Allman
08:45 AM Bug #58 (In Progress): 403 forbidden errors for many consecutive asynchronous writes (15 bytes @ ...
The problem is that asynchronous appends are sent off to the thread pool in gdplogd. Those threads are not guarantee... Eric Allman
05:16 PM Bug #58: 403 forbidden errors for many consecutive asynchronous writes (15 bytes @ 100 Hz)
I believe the bug is because of the timing of multiple worker threads. I verified that
* the bug exists on the lat...
Nitesh Mor
07:02 AM Bug #60: New GDP log created on log server inaccessible by gdp-reader.
I did get a chance between meetings yesterday to look through logs, and I didn't see any restarts around the same tim... Eric Allman
05:21 PM Bug #60: New GDP log created on log server inaccessible by gdp-reader.
A bit of detail (not sure how important it is):
* gdp-01 is running on 14.04, where a watcher programs restarts th...
Nitesh Mor
05:01 PM Bug #54 (Closed): Multiple multi-reads (of size 1, typically) do not return the correct number of...
Verified read_async works. Closing this. Thanks Nitesh Mor

09/29/2016

04:44 PM Bug #59 (Closed): Segmentation fault in gdp-reader on subscriptions
Seems to be fixed. I can't reproduce it anymore. Thanks Nitesh Mor
11:43 AM Bug #60: New GDP log created on log server inaccessible by gdp-reader.
I can still reproduce, but the problem only seems to happen when the log is created on a log server other than gdp-01... David Mellis
11:36 AM Bug #60 (Feedback): New GDP log created on log server inaccessible by gdp-reader.
For some reason I am no longer able to reproduce the problem, despite having made no code changes since yesterday. I... Eric Allman
05:23 PM Bug #60 (In Progress): New GDP log created on log server inaccessible by gdp-reader.
A bit more detail on this problem: The exact sequence must be:
1. `gcl-create`
2. `gdp-reader -s`
This causes...
Eric Allman

09/28/2016

04:41 PM Bug #57: GDP Make Error
Is it possible to have a list of the packages that are required, so that I can perform these manual tweaks?
Thanks.
Nima Mousavi
04:35 PM Bug #57 (Resolved): GDP Make Error
This should be fixed in commit:4770b39a.
Note that Raspbian is not an officially supported platform. It will prob...
Eric Allman
04:04 PM Bug #60 (Closed): New GDP log created on log server inaccessible by gdp-reader.
I created a new GDP log with:
~~~
dhcp-45-14:apps mellis$ ./gcl-create -C mellis@berkeley.edu -k none edu.berkele...
David Mellis
02:55 PM Bug #55: GDP log subscribe hangs
As I mentioned in my other bug report, I cannot run gdp-setup.bash on Raspberry Pi, because it is not supported. I ru... Nima Mousavi
12:28 PM Bug #55 (Feedback): GDP log subscribe hangs
Nima, could you verify that this is still broken on the latest code base? You'll have to recompile libgdp and your a... Eric Allman
12:04 PM Bug #55: GDP log subscribe hangs
I'm currently pulling data from a log that I'm feeding the data to. So I think the data is being logged in there, it ... Nima Mousavi
09:50 PM Bug #55: GDP log subscribe hangs
`__func1` is just a name for `gdp_event_next`. As per the trace in the JPEG file (really?), it is called with a NULL ... Nitesh Mor
12:24 PM Bug #59 (Feedback): Segmentation fault in gdp-reader on subscriptions
This appeared in my recent commit for issue #54. It should be fixed in commit:60e57723. Please double check that it... Eric Allman
10:22 PM Bug #59 (Closed): Segmentation fault in gdp-reader on subscriptions
On a log with no new appends, leaving a subscription running causes segmentation fault after a while. See a detailed ... Nitesh Mor
10:51 AM Bug #54 (Feedback): Multiple multi-reads (of size 1, typically) do not return the correct number ...
Should have been fixed in commit:4d6ff457. However, it turns out that small multi-reads still serialize behind the a... Eric Allman
10:25 PM Bug #54: Multiple multi-reads (of size 1, typically) do not return the correct number of events.
commit:4d6ff457 seems to have it fixed. I can no longer reproduce the bug.
Leaving this open though, just in case...
Nitesh Mor
05:16 PM Bug #58: 403 forbidden errors for many consecutive asynchronous writes (15 bytes @ 100 Hz)
At the moment, this is happening reasonably often for data at 10 Hz. Weirdly, ping times seem to be better:
~~~
P...
David Mellis

09/27/2016

04:52 PM Bug #57: GDP Make Error
I just tried gdp-setup.sh.
On Raspberry Pi it doesn't work because Raspbian is not supported by the script. Does thi...
Nima Mousavi
12:54 PM Bug #57 (In Progress): GDP Make Error
Have you tried running adm/gdp-setup.sh? The recent query-by-timestamp function has added a dependency on libdb. Eric Allman
09:59 AM Bug #57 (Closed): GDP Make Error
I have pulled the most recent versions of GDP, but when I run sudo make, I receive a fatal error. I've attached the e... Nima Mousavi
04:07 PM Bug #58 (Closed): 403 forbidden errors for many consecutive asynchronous writes (15 bytes @ 100 Hz)
I'm piping data of around 15 bytes per reading (line) at 100 Hz to `./gdp-writer -a edu.berkeley.eecs.bid.mellis.ardu... David Mellis
11:25 AM Bug #56: Crash if isatty() returns true but TERM isn't set.
Thanks! David Mellis
07:07 AM Bug #56 (Resolved): Crash if isatty() returns true but TERM isn't set.
Sorry about that. Should be fixed in commit:0decb227. Eric Allman
07:22 AM Bug #55: GDP log subscribe hangs
Nitesh, I'm passing this one to you because Nima is seeing the problem in __func1, which is part of the Python API. ... Eric Allman
07:21 AM Bug #49 (Closed): Darwin: shared libraries have the wrong internal name
Thanks, this works for me now so I'm closing this. Anonymous
07:14 AM Bug #50: router will sometimes connect to itself
Dropping this to low priority because at the moment it doesn't seem to be causing any operational problems.
Might ...
Eric Allman

09/26/2016

02:04 PM Bug #56: Crash if isatty() returns true but TERM isn't set.
BTW, this was for an old commit (202d751a0d47c3ecd6d025e68b4ddb4f7a665b45) so it may not apply any more. David Mellis
01:33 PM Bug #56 (Closed): Crash if isatty() returns true but TERM isn't set.
I'm getting a crash on line 289 of ep_string.c when running an application linked against the GDP from within Xcode. ... David Mellis
10:55 AM Bug #55 (Closed): GDP log subscribe hangs
I've been using the function calls that have been used in gdp/lang/python/reader_multi_subscribe.py, and I'm facing t... Nima Mousavi

09/24/2016

07:30 PM Bug #54 (Closed): Multiple multi-reads (of size 1, typically) do not return the correct number of...
For a multi-read of size 1, a client should receive 2 events (GDP_EVENT_DATA followed by GDP_EVENT_EOS). In case of N... Nitesh Mor

09/23/2016

10:06 AM Bug #53 (Closed): Segfault in gdp-reader.c; cleanup of signature buffer
Seems to work. Closing. Nitesh Mor
02:22 AM Bug #53 (Feedback): Segfault in gdp-reader.c; cleanup of signature buffer
The analysis is correct; the signature buffer reuse was broken. Fixed in commit:354ee62a.
We should really elimin...
Eric Allman
01:10 AM Bug #53 (Closed): Segfault in gdp-reader.c; cleanup of signature buffer
In the case of a log with signatures, an EOF causes a segmentation fault. Here's an example of how to reproduce it:
...
Nitesh Mor
12:45 AM Bug #52 (Closed): Repeated gdp_gcl_open calls on non-existing GCLs do not give proper error code ...
Seems to work. Closing the issue. Nitesh Mor
12:14 AM Bug #52 (Feedback): Repeated gdp_gcl_open calls on non-existing GCLs do not give proper error cod...
Problem was that the unopened GCL was being kept in the cache; the subsequent calls to gdp_gcl_open found the cached ... Eric Allman

09/19/2016

09:18 PM Bug #52: Repeated gdp_gcl_open calls on non-existing GCLs do not give proper error code (was: GDP...
Good point. There was a minor change in `GDP_GCL(...)` to better match it with the underlying C-API behavior. More sp... Nitesh Mor

09/18/2016

05:42 AM Bug #52 (Closed): Repeated gdp_gcl_open calls on non-existing GCLs do not give proper error code ...
When opening a non-existing GCL, the gdp.GDP_GCL function in the Python API only raises an error during the first att... Rico Maestro
 

Also available in: Atom