muppeth - muppeth@hub.disroot.org

muppeth

Sun, 23 Jun 2019 01:11:24 +0200

!Hubzilla Support Forum
Going through logs I see lots of:
:Router.php:179:__construct: index.php: page not found: /receive/public ADDRESS: ... QUERY: q=/receive/public
Any hints? Tried checking Router.php but not sure if it means I should ignore it or indeed there is a missing module and if so which.

Mike Macgirvin

Sun, 23 Jun 2019 03:13:09 +0200

That's a remote server trying to deliver to Diaspora, which you've mentioned elsewhere it not currently enabled - hence your server can't find that endpoint.

muppeth

Sun, 23 Jun 2019 12:15:41 +0200

Thanks for clearing that one out.

muppeth

Sun, 23 Jun 2019 00:23:47 +0200

!Hubzilla Support Forum

What does the error in the logs mean
Finger.php:139:run: invalid signed token: https://hub.disroot.org/.well-known/zot-info?f=&address=user&token=... Does that means channel does not exist?

NetNut404

Sun, 23 Jun 2019 01:10:27 +0200

I haven't got any response from hub.disroot.org in a while so I suppose it can't reach it

muppeth

Sun, 23 Jun 2019 01:16:59 +0200

I'm posting from hub.disroot.org so obviously it's online. I do have some issues mainly apearing the moment I switch diaspora addon on (causing my db to choke because of concurrent processes). I dont know whether this is the root cause (the diaspora addon is currently off) but i'm now trying to go thought logs to resolve all possible warnings/issues before I move on to diaspora.

The fact you see my post and I see yours should indicate hub.disroot.org is online. That piece from logs is just one server. I see also hubzilla.eu;hub.g3l.org;gerzilla.de; start.hubzilla.org;hub.weho.st and few others.

Mike Macgirvin

Sun, 23 Jun 2019 01:25:48 +0200

Ultimately there are hundreds of things which could cause this, but it basically means that somebody on the other end signed a request and we couldn't verify the signature on your end. Assuming it isn't a blatant forgery, It is highly unlikely to be an issue caused by your server, and very likely to be an issue with the requestor's server. It could be as simple as the server not responding in a timely manner.

If it's causing an identifiable/recurring problem we might need logs on both sides to figure out the ultimate cause. But if it eases your mind a bit, we upgraded this particular verification step to use OWA probably around two years ago and still support the old mechanism, but it's pretty ancient. This tells me the other server is probably running really, really old code and if it's causing an issue the very first thing I would do is get them to update.

muppeth

Wed, 19 Jun 2019 14:09:31 +0200

I've been asked at work to edit a short video. I have a feeling it will be a dumpster fire on its own excluding the software choice (no real concept and the bad material to work with).
I havent use any video editing software for long time. And last time I used one was when @Antilopa and I were making apt-get shirt video

apt-get shirt --build
by apt-get shirt on Vimeo

Which we ended up doing in blender. I have close to zero skills in blender (all hard work was dne by antilopa) so I need to find other solution. I see quite some new kids on the video editing bloc, so I decided to test our Shotcut and Flowblade. Anyone with expirience in either. I hope the crash rate will be lower then all the other video editing software I worked with in the past.

#videoediting #videoeditingsoftware

projects

Foks

Wed, 19 Jun 2019 14:12:03 +0200 from ActivityPub

@muppeth @antilopa I use kdenlive for my quadcopter videos, which works alright. Crashes very rarely, so do keep saving your project

meaz

Fri, 21 Jun 2019 05:53:19 +0200

I also use Kdenlive. It works fine.

NullSpaceOddity

Fri, 21 Jun 2019 06:59:21 +0200

I've used Openshot for some projects. It was fairly intuitive for basic stuff, but not really stable.

Cinelerra GG is much more stable, but has a pretty big learning curve.
Cinelerra GG Infinity free video editing software for linux

Cinelerra GG Infinity is a free video editing software or program for Linux. Edit your videos like a pro for YouTube, Facebook and Instagram.

Missing and broken thumbnails

muppeth

Tue, 18 Jun 2019 03:20:45 +0200

!Hubzilla Support Forum
Since migration of thumbnails to fs I noticed quite few thumbnails missing, low quality or broken.

Gallery displays only couple of thumbnails. Missing thumbs are replaced with random ones (my pretty face in this case).

Once pressed to view the image in fullscreen the proper image is displayed, though I notice couple of them missing too. Also noticed my thumb in low quality.
I did run util/thumbrepair few times but with no success.

show all 6 comments

Xosé M

Tue, 18 Jun 2019 08:44:50 +0200

good morning! #TZAG

I'm now writting from cloned identity, dis-hub seems a little buggy this days. Hope all backs to normal.

Few days ago my avatar was changed to some default bird (eagle), I noticed some other users got this avatar though, so I guess was some missconfiguration.

Thanks anyway!

Mario Vavti

Tue, 18 Jun 2019 09:38:43 +0200

@muppeth there was another fix for the repair script shipped with 4.2.1
You might want to try util/thumbrepair once more after updating to 4.2.1

Max Kostikov

Tue, 18 Jun 2019 18:21:33 +0200

@muppeth
I just sent MR to master which probably should fix your issue with util/thumbrepair
https://framagit.org/hubzilla/core/merge_requests/1673

muppeth

Tue, 18 Jun 2019 19:10:39 +0200

@Mario Vavti I'm pretty sure I did it after the update again, I'll wait for @Max Kostikov merge and run it again. Thanks for looking into this.

Mario Vavti

Tue, 18 Jun 2019 19:24:32 +0200

Merged.

muppeth

Tue, 18 Jun 2019 23:40:04 +0200

Pulled and executed thumbrepair again. Looks like more of the thubnails is back. I see few white ones, but they do load when opening, so it might be my cache, generally something I can live with (hope that applies for others on my instance). Thanks a lot guys.

muppeth

Tue, 18 Jun 2019 02:18:29 +0200

Mike Macgirvin wrote the following post Tue, 18 Jun 2019 02:16:00 +0200

Share freedom – Get this Extension for 🦊 Firefox (en-US) Share freedom – Get this Extension for 🦊 Firefox (en-US)

Download Share freedom for Firefox. share the current tab on the fediverse

Diaspora addon temporarily disabled

muppeth

Thu, 13 Jun 2019 01:59:42 +0200

!Disroot Community
Due to stability issues caused by what looks to be Diaspora Addon, federation to d* has been disabled until the root cause is identified and fixed.

Lepe

Thu, 13 Jun 2019 18:50:23 +0200

Diaspora addon causes huge flood

muppeth

Thu, 13 Jun 2019 01:54:54 +0200

!Hubzilla Support Forum
For quite some time my instance is struggling with performance. Since last two days to the point it is essentially dead. No matter how many php processes I set, it will get filled up and fillup db with queries.

I see my hubzilla logs flodded with:


Receiver.php:1459:like: diaspora_like: parent item not found:
Receiver.php:748:comment: diaspora_comment: parent item not found: parent:

i have now disabled diaspora addon (i wonder what will happen now with all the accounts followed), and issue with db flooded with queries has stopped and I can finally write this post.
I would apreicate any suggestions, help or feedback on that issue. If there is anything you want me to run to provide more information in order to find solution to this, please let me know. I run latest hubzilla 4.2 (though the issue is there since about 2 months), php7.3 and postgres.

show all 17 comments

Eudaimon ꙮ

Thu, 13 Jun 2019 06:59:03 +0200

muppeth

Thu, 13 Jun 2019 23:06:31 +0200

I'm not sure this post has reached outside our instance. Can someone confirm they see it (outside hub.disroot.org)?

fridaysforfuture, but everyday

Thu, 13 Jun 2019 23:17:04 +0200 from ActivityPub

@muppeth I saw it from hub.librenet.de and todon.nl

There might be an issue with the server the support forum is hosted,..

paulfree14

Thu, 13 Jun 2019 23:22:40 +0200

jup, it says: " Apologies but this site is unavailable at the moment. Please try again later. "
see:
https://zotadel.net/channel/support

Foks

Thu, 13 Jun 2019 23:36:42 +0200 from ActivityPub

@muppeth confirming from pixie.town, no idea how to help tho :/

Iron Monkey

Fri, 14 Jun 2019 00:55:42 +0200

Can see it from hub.subzone.net @muppeth

Waitman Gobble

Fri, 14 Jun 2019 02:58:58 +0200

Something was killing my server too. I had a feeling it was diaspoora. Turning off all the plugins seemed to fix the issue i was having.

Mario Vavti

Fri, 14 Jun 2019 09:07:23 +0200

@muppeth we have been receiving malformed diaspora messages from friendica for some time. Not sure if that is still the case though. I have added some additional checks and loging to the diaspora addon. Please update with util/udall and see if the situation improves...

Alex

Coruscant, Fri, 14 Jun 2019 10:30:43 +0200

Diaspora Protocol is blocking my server zotadel.net almost completely at the moment.
I disabled all addons with "safemode off".

muppeth

Fri, 14 Jun 2019 12:17:27 +0200

@Mario Vavti Thanks. Updating addons, does the core need to be updated too (just to know if i need to merge to my fork).

Mario Vavti

Fri, 14 Jun 2019 12:28:50 +0200

There is a fix to the calendar in core. You should probably pull that too...

muppeth

Sat, 15 Jun 2019 13:11:24 +0200

hmmm.... The moment I re-enable diaspora addon the flood starts. At first I thought it might be due to lots of stuff missing because of the addon being off for few days, but it does look like it it just continues eg: Receiver.php:458:post: diaspora_post: Ignoring this author. (and the above. I will re-enable it this evening to post some queries that I see from db side as well as maybe more logs if needed.

Please let me know what is needed or what should I look at to find the root cause.

Mario Vavti

Sat, 15 Jun 2019 16:59:23 +0200

Ignoring this author

That is not an error message.

muppeth

Sat, 15 Jun 2019 21:49:55 +0200 last edited: Sat, 15 Jun 2019 21:52:42 +0200

Yeah I know. But the log is litterally flodded with those. I can barely see anything else. But yeah I will look around compile some logs and post some more observations.

Mario Vavti

Sat, 15 Jun 2019 23:01:19 +0200

I have just raised the loglevel for those messages to LOGGER_DEBUG. If you use a loglevel below, you should not see those messages anymore.

IIRC hub.disroot.org is subscribed to the social-relay with scope all. Maybe that just became overwhelming for your server?

muppeth

Sun, 16 Jun 2019 13:18:18 +0200

Possibly. Though we run it on baremetal with 24 cores and 32GB RAM and much heavier services we run on similar setup manage. It's not that I'm bothered by the messeges in the logs (its imo good to see them) I just wonder what exactly they mean and why it floods so much. I mean I'm subscribed to the same relay server with the same settings on diaspora and do not notice such a flood.
I would like to understand what is happening. Hmmm... I remember I have switch off fiorehose already months ago: config[diaspora][firehose] = 0

Mario Vavti

Sun, 16 Jun 2019 14:55:32 +0200

It's not that I'm bothered by the messeges in the logs (its imo good to see them) I just wonder what exactly they mean and why it floods so much.

It just tells you that a received messages is not allowed in a channels network stream.

Hubzilla updated to version 4.2

muppeth

Sat, 08 Jun 2019 01:33:16 +0200

!Disroot Community
Hi there.

As our hubzilla seems to be stable for last few days, which is great as it wasn't feeling well for past two months, its time to start working on it again. Starting from update released just few days ago:
Below you can see the link to the change log. If you are using Events or CalDAV app, it now has been merged and replaced by Calendar app. Make sure to enable it in
https://hub.disroot.org/apps/available

Here is the link to ChangeLOG: https://framagit.org/hubzilla/core/tags/4.2

muppeth

Thu, 06 Jun 2019 10:00:59 +0200

GNOME wrote the following post Thu, 06 Jun 2019 08:08:32 +0200

The @kde has done an absolutely incredible job creating a truly world class user experience. We at GNOME appreciate everything you have done to push the #FOSS desktop forward, and we continue to be inspired by your community and vision! 🤗

https://pointieststick.com/2019/06/05/kde-usability-and-productivity-are-we-there-yet/

muppeth

Wed, 05 Jun 2019 22:33:28 +0200

Havent posted much lately (if at all). Our hubzilla instance got a bit more stable these days and i hope this state will continue. I'm thus planning to be more active in the fediverse.

muppeth

Sun, 19 May 2019 17:13:19 +0200

!Disroot Community

Disroot State wrote the following post Sun, 19 May 2019 13:38:02 +0200

Nextcloud update

Monday, about midnight (CEST - Amsterdam Local Time), we will be upgrading nextcloud (https://cloud.disroot.org) to the latest version. This means for about 1 hour the service will not be available.

muppeth

Fri, 03 May 2019 22:51:46 +0200

!Hubzilla Support Forum

Hey. For weeks now my hub struggles with issue I did not manage to solve on my own. @Mario Vavti was trying to help out a bit, but I think bringing it to more people might spark some discussion resulting in finding out a root cause of the issue.

Since last updates (i think as my other post 0.4.0.1) my db is flodded by DEALLOCATE tasks (like DEALLOCATE pdo_stmt_0000559c). Those will grow to the amount of php workers setup (even if i crank it to like 200) which will result in the site unavailable until the tasks are finished. That in turn will work for short while until new deallocates build up again. I have not notice that prior the update and the instance was pretty snappy. Even currently once there is room for new php processes to do their job, the instance works well.

I run out of ideas here so thought someone might look at it with 'fresh eyes' and ask some questions that will bring the debugging on the right track. !Hubzilla Support Forum

Hans W

Fri, 03 May 2019 23:56:54 +0200 from Diaspora

Is it working with persistent connections?

Hans W

Sat, 04 May 2019 00:05:13 +0200 from Diaspora

A normal prepare would solve this but I think you might bump into another problem. If mysql is used then enable slow query logging. Based on that you might want to enable or disable some indexes. If a lot of indexes are used and updated then it will reindex after every insert, update or delete statement.

Logs flodded with missing column "channel_w_photos"

muppeth

Fri, 03 May 2019 22:15:35 +0200

!Hubzilla Support Forum

Sorry for double posting (added issue on git) but wasn't sure whether this is not a better place to post to.
For last weeks (possibly since update to 0.4.0.1) my server keeps spitting out SQL error of Undefined column: 7 ERROR: column "channel_r_photos" of relation "channel" does not exist

I did not find out which addon is causing it, and though someone here might know. I'm using postgres.

show all 10 comments

muppeth

Sat, 04 May 2019 16:00:22 +0200

@Mike Macgirvin ⚡ Looks like this did the trick. Thanks a lot for quck fix!

Max Kostikov

Sat, 04 May 2019 17:06:51 +0200

@muppeth Can we close issue report?
https://framagit.org/hubzilla/core/issues/1367

muppeth

Sat, 04 May 2019 22:09:26 +0200

@Max Kostikov Yes i think so. Sorry for double posting and thanks for responding on git really fast too.

muppeth

Sun, 07 Apr 2019 15:07:48 +0200

!Disroot Community

Disroot State wrote the following post Sun, 07 Apr 2019 12:55:00 +0200

Nextcloud bookmarks app disabled

Due to a bug causing server crash in connection to bookmark app usage, we have disabled it temporarily. We do have an idea on what might be going on and will investigate the issue asap.

photos table huge

muppeth

Sun, 07 Apr 2019 10:13:41 +0200

!Hubzilla Support Forum
It looks like the biggest table in the database is 'photos'. On my instance it's currently 15GB. Wouldnt it make more sense to save them in a file?

show all 7 comments

Mike Macgirvin

Sun, 07 Apr 2019 10:54:32 +0200

Only the thumbnails are typically stored in the DB. the original full-size image is stored in the filesystem. If you have the photocache addon installed, you're going to end up with all kinds of extra stuff in the DB.

Historically we've been migrating these to the filesystem - originally *all* photos were stored in the DB. We did this because most of the early admins had no administration skills and we wanted to be able to verify that you couldn't access a private photo through some backdoor in the webserver, You *had* to go through our code and have the permissions checked.

I'd be quite happy to move thumbnails to the filesystem also and I think the photocache really should be in the filesystem since it isn't dealing with privacy. There are some performance issues with lots of files in directories on some platforms, so these should really be put in hash directories so they are spread out. Otherwise, sure, just do it.

Max Kostikov

Sun, 07 Apr 2019 11:54:35 +0200

I think the photocache really should be in the filesystem

Already there and always was. In photocache photos table used for metadata only.

Max Kostikov

Sun, 07 Apr 2019 12:17:26 +0200

I'd be quite happy to move thumbnails to the filesystem

I believe this shouldn't be hard to implement.

Mike Macgirvin

Sun, 07 Apr 2019 22:11:25 +0200

Already there and always was.

My apologies @Max Kostikov. I didn't check and I probably should have.

Max Kostikov

Sun, 07 Apr 2019 22:20:41 +0200

@Mike Macgirvin ⚡ No problem. And thank you for idea about moving thumbnails to filesystem - right now I investigate this.

Malte

Mon, 08 Apr 2019 07:39:40 +0200 last edited: Mon, 08 Apr 2019 07:39:35 +0200

@Max Kostikov if I activate the addon. Where can I found the files? I which folder? And is there something to do some configurations?

Max Kostikov

Mon, 08 Apr 2019 09:28:13 +0200

@Malte
store/[data]/[cache]

muppeth

Thu, 04 Apr 2019 10:41:07 +0200

HU Art Sound (2) wrote the following post Wed, 03 Apr 2019 23:04:30 +0200

Tennis balls are flat
Image/photo

#flatearthers

soila

Thu, 04 Apr 2019 10:47:24 +0200

psymin

Thu, 04 Apr 2019 17:01:23 +0200

Holy smokes. I'm convinced. I don't know what took me so long to see the light.

muppeth

Sat, 30 Mar 2019 16:33:32 +0100

JC Brand wrote the following post Sat, 30 Mar 2019 14:01:12 +0100

I'm at the Berlin #XMPP sprint, working on improving OMEMO support for Converse.js.

There are over 20 people here and we're testing OMEMO encryption interoperability across 12 different clients.

muppeth

Tue, 19 Mar 2019 18:06:13 +0100

lostinlight wrote the following post Tue, 19 Mar 2019 17:25:11 +0100

#Fediverse issues

"help wanted" - #Hubzilla -> link

"Junior Jobs" - #Friendica -> link

"help wanted" - #diaspora -> link

"fit for beginners" - #Mastodon -> link

"needs help" - #Misskey -> link

"good first issue" - #Peertube -> link

"needs #design" / "easy" - #Pleroma -> link 1 / link 2

"help wanted" - #Socialhome -> link

API endpoint for notifications

muppeth

Tue, 19 Mar 2019 10:45:12 +0100

!zotlabs.org | Hubzilla Development
Some time ago I posted about it but did not get answer. It was also in the time when my server was having some trouble so maybe that post did not federate. The question is, is there any documented endpoint to pull notifications?
I want to create simple script for gnome-notifications that would check your hubzilla notifs.

poVoq

Tue, 19 Mar 2019 18:58:39 +0100

Shot in the dark, but this ZotAPI part might be it: https://zotlabs.org/help/de/developer/api_zot#item_update ???

Mike Macgirvin

Wed, 20 Mar 2019 04:17:26 +0100

There's nothing currently available as a standalone notification api. I would probably recommend tying into the 'ping' controller which collects all the current updates and sends them to the browser in JSON. One can authenticate with OWA which requires the requesting service to have a copy of the channel private key.

Hubzilla 4.0 update

muppeth

Thu, 14 Mar 2019 10:28:27 +0100

!Disroot Community
Last night we've updated hubzilla to the latest 4.0 version. Seems like things are working fine. Check Two factor authentication app, and give us some feedback.

show all 16 comments

lotfi

Thu, 14 Mar 2019 10:51:45 +0100

Thanks for the update.
It seems that superblock app doesn't work since the update. I uninstalled it and then reinstalled it. It still doesn't work.

muppeth

Thu, 14 Mar 2019 12:12:10 +0100

Thanks, Maybe I need to do the ol' trick of uninstalling and installing again.....

.... Check now.

lotfi

Thu, 14 Mar 2019 12:34:36 +0100

Still not working. But no rush, It's just a useful trick for shitty stuffs in public stream.

muppeth

Thu, 14 Mar 2019 12:36:01 +0100

Seems like there is some issue with 2FA app (guessing something to do with us using external authentication system). I have therefor disabled it now. I will do some tests later tonight and report to hubzilla dev-crew.

muppeth

Thu, 14 Mar 2019 12:37:19 +0100

I will have a look at this also. Our public stream lately was infested with all kind of nasty stuff. We are blocking most of it now on server wide level.

lotfi

Thu, 14 Mar 2019 13:45:55 +0100

One other thing to note. Also, there is a problem with uploading photos. They are not visible in the gallery but you can see the number of photos uploaded on the panel on the left. This does not seem to affect photos that were already uploaded before the update.

Mario Vavti

Thu, 14 Mar 2019 14:18:56 +0100

@muppeth please double check all updates (1225 - 1230) manualy. It seems in some situations failed updates were not reprted as such for some reason (still investigating).

The photos issue indicates that 1229 failed...

Mario Vavti

Thu, 14 Mar 2019 14:33:57 +0100

BTW have you actually checked /admin/dbsync for failed updates?

muppeth

Thu, 14 Mar 2019 22:33:40 +0100

yeah i did check and only 1228 was marked as failed. i have run the query manually. i will check whether others were applied or not. thanks @Mario Vavti

muppeth

Thu, 14 Mar 2019 23:06:15 +0100

great success. i run through all the updates except for the one i run manually myself. Thanks @Mario Vavti for being around even when not poked. Amazing support.

muppeth

Thu, 14 Mar 2019 23:22:57 +0100

@lotfi not sure how i can test superblock so maybe you can check and confirm whether its now ok.

lotfi

Fri, 15 Mar 2019 08:22:23 +0100

Hi @muppeth Superblock is still not working for me (it works well on my clone on another hub).
Uploading photos is now working great. Thanks.

Mario Vavti

Fri, 15 Mar 2019 08:29:45 +0100

@muppeth might need to disable and re-enable the superblock addon from the admin/addons panel.

muppeth

Fri, 15 Mar 2019 09:38:16 +0100

Re-enabled.

muppeth

Fri, 15 Mar 2019 09:40:59 +0100

Seems to be working. i just blocked someone and the posts disapeared from the stream.

lotfi

Fri, 15 Mar 2019 10:22:50 +0100

Seems to be working

YES!!!