GDP

10/16/2016

11:15 PM Bug #76: ERROR: request freed while in use

I can not seem to reproduce this bug. It would be helpful to see some more debugging information. Could you please do... Nitesh Mor

07:16 PM Bug #76 (Closed): ERROR: request freed while in use

The Local GDP seems to be crashing a lot. I see same errors as in bug #69 .
```
sbuser@swarmnuc015:~$ gdp-reader ... Syed Hasnain

10:59 PM Bug #58 (Closed): 403 forbidden errors for many consecutive asynchronous writes (15 bytes @ 100 Hz)

Marking this closed for now, I can not seem to reproduce this.
If the issue persists, please reopen. Nitesh Mor

10:57 PM Support #72: gcl-create hangs intermittently.

It seems more like an infrastructure related issue, than a bug. If you encounter this again, could you please include... Nitesh Mor

10:49 PM Bug #74 (Feedback): Asyn Write/Subscribe

Nitesh Mor

10:48 PM Bug #74: Asyn Write/Subscribe

I believe this is an issue related to subscriptions, rather than mode of append (synchronous vs asynchronous). More s... Nitesh Mor

10:35 PM Bug #75 (Feedback): Subscription times out

Hopefully fixed in commit:7bf6e9b2. It is a server side bug, and still needs to be deployed to production infrastruct... Nitesh Mor

07:03 PM Bug #75 (In Progress): Subscription times out

I have been able to narrow down the bug to subscription renewals in `gdplogd`.
Specifically, any post processing c... Nitesh Mor

10/15/2016

03:57 PM Bug #75 (Closed): Subscription times out

As reported in #74, #55 and an email from Rico, it looks like there is a common bug, which is: subscriptions going aw... Nitesh Mor

02:52 PM Support #73: Can't write to log edu.berkeley.eecs.bid.mellis.arduino101

`gdplogd` on gdp-03 was messed up, I restarted it and it seems to work. What caused this, is still unknown.
One th... Nitesh Mor

02:43 PM Feature #31 (Closed): Systemd debian packaging scripts for log-server

Nitesh Mor

10/14/2016

04:34 PM Bug #74: Asyn Write/Subscribe

> Incomplete PDU fd 8 pduLen 439 bufferDataLen 103
> Incomplete PDU fd 8 pduLen 441 bufferDataLen 157
> Incomplete ... Eric Allman

03:42 PM Bug #74: Asyn Write/Subscribe

The log also contains records like the following for async writing
recno -1, len 0, ts 0 Syed Hasnain

03:40 PM Bug #74 (Closed): Asyn Write/Subscribe

If I write async to log, router log is filled with such messages:
Incomplete PDU fd 8 pduLen 439 bufferDataLen 103... Syed Hasnain

03:35 PM Bug #69: Read, Write Errors

Nitesh Mor wrote:
> Edited description for readability.
Seeing this error on local GDP as well. Restarting the gd... Syed Hasnain

01:02 PM Bug #64: gdplogd to gdp-router-click communications getting out of sync

gdplogd has been updated so that it doesn't complain if records arrive out of order. Unfortunately this also means t... Eric Allman

12:08 PM Support #73: Can't write to log edu.berkeley.eecs.bid.mellis.arduino101

Here's the debugging output, which includes an assertion failure and exit that I don't see when running without debug... David Mellis

12:03 PM Support #73 (Closed): Can't write to log edu.berkeley.eecs.bid.mellis.arduino101

When I run the following command:
~~~
./gdp-writer -a edu.berkeley.eecs.bid.mellis.arduino101
~~~
and enter l... David Mellis

11:58 AM Support #72 (Closed): gcl-create hangs intermittently.

This was hanging for me, then started working again:
~~~
./gcl-create -C mellis@berkeley.edu edu.berkeley.eecs.bi... David Mellis

10/13/2016

11:50 AM Bug #71 (Closed): Python shared library version mismatch

(On OS X)
When importing the Python library, I get
OSError: dlopen(/Volumes/code/berkeley/gdp/lang/python/gdp/../... Pat Pannuto

10:53 AM Bug #70 (Closed): Makefiles do not respect environmental CFLAGS

Convention is to use CFLAGS += ... in Makefiles so that users can pass additional arguments via the command line. The... Pat Pannuto

10/09/2016

03:34 PM Bug #69: Read, Write Errors

Edited description for readability. Nitesh Mor

10:09 AM Bug #61: GDP Error 600

I just pulled gdp again and tried one more time.
**On my RPi:**
* It seems to be working, and it is logging this ... Nima Mousavi

10/08/2016

03:20 PM Bug #69: Read, Write Errors

Hi Eric,
I thought I was running the latest gdp version, after cloning it from the repo, i will check again. Yes T... Syed Hasnain

02:04 PM Bug #69 (In Progress): Read, Write Errors

As near as I can tell, the log server (gdplogd) is losing synchronization with the router layer under high load. I t... Eric Allman

03:12 PM Bug #57 (Closed): GDP Make Error

Eric Allman

03:11 PM Feature #63 (Closed): Refresh advertisements in gdplogd

Eric Allman

10/07/2016

03:26 PM Bug #61: GDP Error 600

The `gdplogd`s on gdp-01 and gdp-04 seem to have hung, hence the timeouts. It was hard to restart on both systems: ... Eric Allman

02:42 PM Bug #61: GDP Error 600

I am receiving a new error on my RPi (that was previously working).
I have attached the log for both systems. On swa... Nima Mousavi

07:39 AM Bug #61: GDP Error 600

Assuming you have the regular client software installed, please capture the output of
gdp-reader -n 1 -D50 edu... Eric Allman

07:29 PM Bug #61: GDP Error 600

I checked that parameter before. On RPi (which works) I have the following parameters set in /usr/local/etc/ep_adm_pa... Nima Mousavi

06:19 PM Bug #61: GDP Error 600

That looks like the client can't open a connection to the GDP router. This could be because of a network configurati... Eric Allman

05:33 PM Bug #61: GDP Error 600

Hi,
As far as I can see, error 600 is gone. I am able to run my codes on on one of my RPis (Ubuntu Mate) and I'm ye... Nima Mousavi

01:15 PM Bug #69: Read, Write Errors

Getting this on trying to read now.
sbuser@swarmnuc015:~$ gdp-reader -t edu.tamu.watch1.test
Reading GCL tl0B... Syed Hasnain

12:30 PM Bug #69 (Closed): Read, Write Errors

Get the following errors while trying to write or read to GDP , have successfully written and read these logs earlier... Syed Hasnain

08:13 AM Bug #64 (New): gdplogd to gdp-router-click communications getting out of sync

(It's not clear if this is a gdplogd or a gdp-router-click bug, but gdplogd is my first guess.)
Logs on gdp-01 see... Eric Allman

10/06/2016

11:56 AM Bug #57: GDP Make Error

Thank you very much.
I've been trying to run on another RPi system (Ubuntu Mate OS) which seems to work for now. I'l... Nima Mousavi

09:05 AM Bug #57 (Feedback): GDP Make Error

Nima, sorry, I never responded to your question. The most current list of packages is going to be in adm/gdp-setup.s... Eric Allman

08:51 AM Bug #61 (Feedback): GDP Error 600

Nima, please give it another try. I fixed a router bug late yesterday that might be the problem. Eric Allman

07:07 AM Bug #60: New GDP log created on log server inaccessible by gdp-reader.

I found a definite bug in the router code that caused log names to get mangled in some circumstances if they had zero... Eric Allman

10/04/2016

03:31 PM Bug #60 (In Progress): New GDP log created on log server inaccessible by gdp-reader.

Just to bring everyone up to date, I'm looking at this. The problem is clearly at the routing layer, so I'm moving t... Eric Allman

09:31 AM Bug #60: New GDP log created on log server inaccessible by gdp-reader.

FWIW - The Ptolemy II nightly build has been failing for a few days with ERROR: 600 no route available [Berkeley:Swar... Anonymous

06:02 PM Bug #55: GDP log subscribe hangs

The hanging issue was happening prior to the error 600. So they are separate issues.
There is data being added to ... Nima Mousavi

05:29 PM Bug #55: GDP log subscribe hangs

Nima, can you clarify if the problem you are seeing is that your program hangs or gets a 600 error? The 600 error is... Eric Allman

10/03/2016

02:21 PM Feature #63 (Resolved): Refresh advertisements in gdplogd

This has been added in commit:67898fe7. This adds the `swarm.gdplogd.advertise.interval` parameter, which defaults t... Eric Allman

02:19 PM Feature #63 (Closed): Refresh advertisements in gdplogd

Advertisements for logs in `gdplogd` have not been refreshed, so if the routing layer "loses" a route it is never res... Eric Allman

10:18 AM Bug #61: GDP Error 600

I just tested whether I have access or not, and it seems like on some routers I receive error 600.
Is there anything... Nima Mousavi

10/02/2016

02:50 PM Bug #61: GDP Error 600

To make things more problematic, the other log (`58jK2obVbOma7OwQNkgA7kuYqrEVcy4Tw5hMlREn5jY`) is only accessible by ... Eric Allman

02:31 PM Bug #61: GDP Error 600

Another update: it looks like the router on gdp-01 is the only router that doesn't know about that log, and restartin... Eric Allman

02:14 PM Bug #61: GDP Error 600

Eric Allman wrote:
> The problem is in the router. The log is hosted on gdp-03, and the router on gdp-03 knows abou... Eric Allman

02:12 PM Bug #61: GDP Error 600

The problem is in the router. The log is hosted on gdp-03, and the router on gdp-03 knows about it, but that name ha... Eric Allman

09/30/2016

02:49 PM Bug #55: GDP log subscribe hangs

I tried it again and apparently now it was able to install using the bash script. I still had the same freezing issue... Nima Mousavi

08:49 AM Bug #55: GDP log subscribe hangs

Nima, commit:4770b39a should have fixed the libdb compile problem (sorry, I don't think I remembered to tell you that... Eric Allman

02:47 PM Bug #61 (Closed): GDP Error 600

I've been getting error 600 today when I try to create a gcl, or try to write to some of the logs that I created befo... Nima Mousavi

12:33 PM Bug #56 (Closed): Crash if isatty() returns true but TERM isn't set.

Eric Allman

12:28 PM Bug #58 (Feedback): 403 forbidden errors for many consecutive asynchronous writes (15 bytes @ 100...

David, the servers have been rebooted. If I'm right, this problem should be fixed. Please let me know. Eric Allman

08:45 AM Bug #58 (In Progress): 403 forbidden errors for many consecutive asynchronous writes (15 bytes @ ...

The problem is that asynchronous appends are sent off to the thread pool in gdplogd. Those threads are not guarantee... Eric Allman

05:16 PM Bug #58: 403 forbidden errors for many consecutive asynchronous writes (15 bytes @ 100 Hz)

I believe the bug is because of the timing of multiple worker threads. I verified that
* the bug exists on the lat... Nitesh Mor

07:02 AM Bug #60: New GDP log created on log server inaccessible by gdp-reader.

I did get a chance between meetings yesterday to look through logs, and I didn't see any restarts around the same tim... Eric Allman

05:21 PM Bug #60: New GDP log created on log server inaccessible by gdp-reader.

A bit of detail (not sure how important it is):
* gdp-01 is running on 14.04, where a watcher programs restarts th... Nitesh Mor

05:01 PM Bug #54 (Closed): Multiple multi-reads (of size 1, typically) do not return the correct number of...

Verified read_async works. Closing this. Thanks Nitesh Mor

09/29/2016

04:44 PM Bug #59 (Closed): Segmentation fault in gdp-reader on subscriptions

Seems to be fixed. I can't reproduce it anymore. Thanks Nitesh Mor

11:43 AM Bug #60: New GDP log created on log server inaccessible by gdp-reader.

I can still reproduce, but the problem only seems to happen when the log is created on a log server other than gdp-01... David Mellis

11:36 AM Bug #60 (Feedback): New GDP log created on log server inaccessible by gdp-reader.

For some reason I am no longer able to reproduce the problem, despite having made no code changes since yesterday. I... Eric Allman

05:23 PM Bug #60 (In Progress): New GDP log created on log server inaccessible by gdp-reader.

A bit more detail on this problem: The exact sequence must be:
1. `gcl-create`
2. `gdp-reader -s`
This causes... Eric Allman

09/28/2016

04:41 PM Bug #57: GDP Make Error

Is it possible to have a list of the packages that are required, so that I can perform these manual tweaks?
Thanks.
Nima Mousavi

04:35 PM Bug #57 (Resolved): GDP Make Error

This should be fixed in commit:4770b39a.
Note that Raspbian is not an officially supported platform. It will prob... Eric Allman

04:04 PM Bug #60 (Closed): New GDP log created on log server inaccessible by gdp-reader.

I created a new GDP log with:
~~~
dhcp-45-14:apps mellis$ ./gcl-create -C mellis@berkeley.edu -k none edu.berkele... David Mellis

02:55 PM Bug #55: GDP log subscribe hangs

As I mentioned in my other bug report, I cannot run gdp-setup.bash on Raspberry Pi, because it is not supported. I ru... Nima Mousavi

12:28 PM Bug #55 (Feedback): GDP log subscribe hangs

Nima, could you verify that this is still broken on the latest code base? You'll have to recompile libgdp and your a... Eric Allman

12:04 PM Bug #55: GDP log subscribe hangs

I'm currently pulling data from a log that I'm feeding the data to. So I think the data is being logged in there, it ... Nima Mousavi

09:50 PM Bug #55: GDP log subscribe hangs

`__func1` is just a name for `gdp_event_next`. As per the trace in the JPEG file (really?), it is called with a NULL ... Nitesh Mor

12:24 PM Bug #59 (Feedback): Segmentation fault in gdp-reader on subscriptions

This appeared in my recent commit for issue #54. It should be fixed in commit:60e57723. Please double check that it... Eric Allman

10:22 PM Bug #59 (Closed): Segmentation fault in gdp-reader on subscriptions

On a log with no new appends, leaving a subscription running causes segmentation fault after a while. See a detailed ... Nitesh Mor

10:51 AM Bug #54 (Feedback): Multiple multi-reads (of size 1, typically) do not return the correct number ...

Should have been fixed in commit:4d6ff457. However, it turns out that small multi-reads still serialize behind the a... Eric Allman

10:25 PM Bug #54: Multiple multi-reads (of size 1, typically) do not return the correct number of events.

commit:4d6ff457 seems to have it fixed. I can no longer reproduce the bug.
Leaving this open though, just in case... Nitesh Mor

05:16 PM Bug #58: 403 forbidden errors for many consecutive asynchronous writes (15 bytes @ 100 Hz)

At the moment, this is happening reasonably often for data at 10 Hz. Weirdly, ping times seem to be better:
~~~
P... David Mellis

09/27/2016

04:52 PM Bug #57: GDP Make Error

I just tried gdp-setup.sh.
On Raspberry Pi it doesn't work because Raspbian is not supported by the script. Does thi... Nima Mousavi

12:54 PM Bug #57 (In Progress): GDP Make Error

Have you tried running adm/gdp-setup.sh? The recent query-by-timestamp function has added a dependency on libdb. Eric Allman

09:59 AM Bug #57 (Closed): GDP Make Error

I have pulled the most recent versions of GDP, but when I run sudo make, I receive a fatal error. I've attached the e... Nima Mousavi

04:07 PM Bug #58 (Closed): 403 forbidden errors for many consecutive asynchronous writes (15 bytes @ 100 Hz)

I'm piping data of around 15 bytes per reading (line) at 100 Hz to `./gdp-writer -a edu.berkeley.eecs.bid.mellis.ardu... David Mellis

11:25 AM Bug #56: Crash if isatty() returns true but TERM isn't set.

Thanks! David Mellis

07:07 AM Bug #56 (Resolved): Crash if isatty() returns true but TERM isn't set.

Sorry about that. Should be fixed in commit:0decb227. Eric Allman

07:22 AM Bug #55: GDP log subscribe hangs

Nitesh, I'm passing this one to you because Nima is seeing the problem in __func1, which is part of the Python API. ... Eric Allman

07:21 AM Bug #49 (Closed): Darwin: shared libraries have the wrong internal name

Thanks, this works for me now so I'm closing this. Anonymous

07:14 AM Bug #50: router will sometimes connect to itself

Dropping this to low priority because at the moment it doesn't seem to be causing any operational problems.
Might ... Eric Allman

09/26/2016

02:04 PM Bug #56: Crash if isatty() returns true but TERM isn't set.

BTW, this was for an old commit (202d751a0d47c3ecd6d025e68b4ddb4f7a665b45) so it may not apply any more. David Mellis

01:33 PM Bug #56 (Closed): Crash if isatty() returns true but TERM isn't set.

I'm getting a crash on line 289 of ep_string.c when running an application linked against the GDP from within Xcode. ... David Mellis

10:55 AM Bug #55 (Closed): GDP log subscribe hangs

I've been using the function calls that have been used in gdp/lang/python/reader_multi_subscribe.py, and I'm facing t... Nima Mousavi

09/24/2016

07:30 PM Bug #54 (Closed): Multiple multi-reads (of size 1, typically) do not return the correct number of...

For a multi-read of size 1, a client should receive 2 events (GDP_EVENT_DATA followed by GDP_EVENT_EOS). In case of N... Nitesh Mor

09/23/2016

10:06 AM Bug #53 (Closed): Segfault in gdp-reader.c; cleanup of signature buffer

Seems to work. Closing. Nitesh Mor

02:22 AM Bug #53 (Feedback): Segfault in gdp-reader.c; cleanup of signature buffer

The analysis is correct; the signature buffer reuse was broken. Fixed in commit:354ee62a.
We should really elimin... Eric Allman

01:10 AM Bug #53 (Closed): Segfault in gdp-reader.c; cleanup of signature buffer

In the case of a log with signatures, an EOF causes a segmentation fault. Here's an example of how to reproduce it:
... Nitesh Mor

12:45 AM Bug #52 (Closed): Repeated gdp_gcl_open calls on non-existing GCLs do not give proper error code ...

Seems to work. Closing the issue. Nitesh Mor

12:14 AM Bug #52 (Feedback): Repeated gdp_gcl_open calls on non-existing GCLs do not give proper error cod...

Problem was that the unopened GCL was being kept in the cache; the subsequent calls to gdp_gcl_open found the cached ... Eric Allman

09/19/2016

09:18 PM Bug #52: Repeated gdp_gcl_open calls on non-existing GCLs do not give proper error code (was: GDP...

Good point. There was a minor change in `GDP_GCL(...)` to better match it with the underlying C-API behavior. More sp... Nitesh Mor

09/18/2016

05:42 AM Bug #52 (Closed): Repeated gdp_gcl_open calls on non-existing GCLs do not give proper error code ...

When opening a non-existing GCL, the gdp.GDP_GCL function in the Python API only raises an error during the first att... Rico Maestro