Jump to content
Froxlor Forum

ripieces

Members
  • Posts

    18
  • Joined

  • Last visited

  • Days Won

    1

ripieces last won the day on June 12 2020

ripieces had the most liked content!

ripieces's Achievements

Apprentice

Apprentice (3/14)

  • Conversation Starter
  • Week One Done
  • One Month Later
  • One Year In
  • First Post

Recent Badges

1

Reputation

  1. It redirects to https://docs.froxlor.org/apiguide/index.htmldoc/ I think you want https://docs.froxlor.org/apiguide/ maybe instead (?).
  2. Yeah I was only worrying about admin perspective, I didn't plan adding automatic retrieval for customers. So it wouldn't be really useful for others I guess, meaning that module would be a waste of time for most people (?). Edit: Thanks for sharing those two, I didn't know them.
  3. Is someone already developing a server-side backup module or is there one already? We are currently using some python scripts to backup web content and databases (but not mails, you would need to add that) with duplicity ( https://duplicity.gitlab.io/duplicity-web/ ) locally and then do an rclone ( https://rclone.org/ ) of that onto a remote location, but I am not quite satisfied with them for various reasons. For those interested I will share the current scripts we use since a while now as attachment, since it was lots of work and research to get them to that stage for me at least. (I think I even found some pointers for them earlier in the Froxlor forum, not sure though, don't remember). I know the files are not good and have many flaws and not good practices, but maybe it will help someone for something good. Please read the rclone and duplicity manual before asking questions (not sure if I have much time to answer them) and don't forget to install the python dependencies (I know on one server it's Python 2 and the other 3, but that's the way it is atm)! I want to switch us to BorgBackup ( https://www.borgbackup.org/ ) [it supports append-only destinations] and thought about developing a small module for Froxlor. But I would not want to do that if someone already is working on something like that and close to the finish line (but I currently can't guarantee I will actually do i). I am not sure what the best way is to start coding a Froxlor module (maybe there's s.th. in the Wiki or Forum I didn't find yet) and to be honest I haven't worked with the Froxlor API at all yet. If someone has pointers regarding these would be appreciated. Maybe someone else needs something similar and we can work together a bit somehow? I wanted the GUI (I mean the froxlor admin backend) to support: Multiple Backup locations (local, remote), including append only, and with the borg retention control options (though those are quite complicated, maybe I will just allow some commands to be added) Backup groups, that are assigned to one or multiple backup locations and have different schedules for content, mail, DB Customers can be assigned to a backup group and there can be a default backup group (not sure how to go about global backup atm) Not sure if I forgot s.th. we need for ourselves but I don't plan to go much beyond that to be honest. I do not plan to support reverse backups though ("pull mode", where a server connects to the server to backup) and also not backups on squashfs etc, I don't need it and don't consider it reliable. backup_ssh_remote.py backup.py exclude.txt global_include.txt rclone.py vgs_backup_cron_d_daily
  4. Looking (again / more properly) at the MasterCron.php code Froxlor already uses a locking mechanism based on the PID - however I think this is doomed to fail in my opinion, since cron jobs can run in parallel with different PIDs. (this is wrong info sorry) I tried to run two scripts in parallel, one that does the nss extrausers files and one that does the chown many times each, all went through without any error, so that must be s.th. else.
  5. froxlorlocal is the user we have for the PHP-FPM enabled froxlor-VHOST, hm.
  6. d00p pointed this out on GitHub, this is actually a very good question / fact :S I still think it's related to libnss-extrausers, but that's really weird.
  7. I opened an issue to track the problem on the issue tracker (I hope that is the right thing to do, I am not sure) https://github.com/Froxlor/Froxlor/issues/928 Also added notes about a solution there, but not sure if good. We could continue the discussion here to avoid spamming users that folow it there.
  8. I switched both servers to libnss-extrausers back then for the same reason, because libnss-mysql would make things eally slow and sometimes even stall a bit. This could be indeed the reason, since up to 4 tasks can run at the same time with the default /etc/cron.d/froxlor: # automatically generated cron-configuration by froxlor # do not manually edit this file as it will be re-generated periodically. PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin # */5 * * * * root /usr/bin/nice -n 5 /usr/bin/php -q /var/www/froxlor/scripts/froxlor_master_cronjob.php --tasks 1> /dev/null 0 0 * * * root /usr/bin/nice -n 5 /usr/bin/php -q /var/www/froxlor/scripts/froxlor_master_cronjob.php --traffic 1> /dev/null 5 0 * * * root /usr/bin/nice -n 5 /usr/bin/php -q /var/www/froxlor/scripts/froxlor_master_cronjob.php --usage_report 1> /dev/null 0 */6 * * * root /usr/bin/nice -n 5 /usr/bin/php -q /var/www/froxlor/scripts/froxlor_master_cronjob.php --mailboxsize 1> /dev/null */5 * * * * root /usr/bin/nice -n 5 /usr/bin/php -q /var/www/froxlor/scripts/froxlor_master_cronjob.php --letsencrypt 1> /dev/null 10 0 * * * root /usr/bin/nice -n 5 /usr/bin/php -q /var/www/froxlor/scripts/froxlor_master_cronjob.php --backup 1> /dev/null And each of these tasks can cause a refresh of the extrausers if more than 1 job was run: https://github.com/Froxlor/Froxlor/blob/8f850ee7f3c9339db0c09793496474fe6ab1f41c/lib/Froxlor/Cron/MasterCron.php#L114 https://github.com/Froxlor/Froxlor/blob/8f850ee7f3c9339db0c09793496474fe6ab1f41c/lib/Froxlor/Cron/MasterCron.php#L131
  9. Sadly it didn't help on the h2 one, it just happened again Edit: Just so you can see I really entered the commands: root@h2 ~ # grep -r froxlorlocal /etc /etc/subgid-:froxlorlocal:1279648:65536 /etc/subgid:froxlorlocal:1279648:65536 /etc/gshadow-:froxlorlocal:!::www-data /etc/passwd-:froxlorlocal:x:9999:9999:,,,:/home/froxlorlocal:/bin/false /etc/shadow:froxlorlocal:*:17141:0:99999:7::: /etc/subuid-:froxlorlocal:1279648:65536 /etc/gshadow:www-data:*::froxlorlocal /etc/gshadow:froxlorlocal:!::www-data /etc/shadow-:froxlorlocal:*:17141:0:99999:7::: /etc/php/7.3/fpm/pool.d/h2.vgstudios.co.il.conf:listen.owner = froxlorlocal /etc/php/7.3/fpm/pool.d/h2.vgstudios.co.il.conf:listen.group = froxlorlocal /etc/php/7.3/fpm/pool.d/h2.vgstudios.co.il.conf:user = froxlorlocal /etc/php/7.3/fpm/pool.d/h2.vgstudios.co.il.conf:group = froxlorlocal /etc/group-:froxlorlocal:x:9999:www-data /etc/subuid:froxlorlocal:1279648:65536 /etc/passwd:froxlorlocal:x:9999:9999:,,,:/home/froxlorlocal:/bin/false /etc/group:www-data:x:33:froxlorlocal /etc/group:froxlorlocal:x:9999:www-data
  10. Thank you very much for your reply. I will report back if it solved it in a few days (I have doubts and need to test it).
  11. We have a server with many "customers" (90+, because I tend to separate websites by customers when they are not related) and we get these errors very randomly by email and with about an average of 1 - 2 times per week I think (not every day at least): Subject: Cron <root@h2> /usr/bin/nice -n 5 /usr/bin/php -q /var/www/froxlor/scripts/froxlor_master_cronjob.php --tasks 1> /dev/null Time:3/7/21, 6:40 PM Content: chown: invalid user: ‘froxlorlocal:froxlorlocal’ Edit: I also had it one time already where it failed with "invalid group" instead. It's driving me a bit crazy, since I didn't find the issue yet, but it happens since quite a while, probably since after we updated to Debian 10.x (which is quite a while ago), but this also correlates with the number of "customers". We are using libnss-extrausers on the server so the bug might be related to that. We use PHP-FPM. If anyone has ideas how to go about debugging this problem, help would be appreciated 😃 I already tried / looked for several things. I am suspecting it might be a problem with libnss-extrausers or chown itself or both. On the server that has the problem: root@h2 /etc # grep -r froxlorlocal /etc /etc/subgid-:froxlorlocal:1279648:65536 /etc/subgid:froxlorlocal:1279648:65536 /etc/gshadow-:froxlorlocal:!::www-data /etc/passwd-:froxlorlocal:x:9999:9999:,,,:/home/froxlorlocal:/bin/false /etc/shadow:froxlorlocal:*:17141:0:99999:7::: /etc/subuid-:froxlorlocal:1279648:65536 /etc/gshadow:froxlorlocal:!::www-data /etc/shadow-:froxlorlocal:*:17141:0:99999:7::: /etc/php/7.3/fpm/pool.d/h2.vgstudios.co.il.conf:listen.owner = froxlorlocal /etc/php/7.3/fpm/pool.d/h2.vgstudios.co.il.conf:listen.group = froxlorlocal /etc/php/7.3/fpm/pool.d/h2.vgstudios.co.il.conf:user = froxlorlocal /etc/php/7.3/fpm/pool.d/h2.vgstudios.co.il.conf:group = froxlorlocal /etc/group-:froxlorlocal:x:9999:www-data /etc/subuid:froxlorlocal:1279648:65536 /etc/passwd:froxlorlocal:x:9999:9999:,,,:/home/froxlorlocal:/bin/false /etc/group:froxlorlocal:x:9999:www-data On the second server that has very similar setup, but way less customers and never has that error: root@h3:~# grep -r froxlorlocal /etc /etc/shadow-:froxlorlocal:*:17990:0:99999:7::: /etc/subuid:froxlorlocal:100000:65536 /etc/php/7.3/fpm/pool.d/h3.vagas.co.il.conf:listen.owner = froxlorlocal /etc/php/7.3/fpm/pool.d/h3.vagas.co.il.conf:listen.group = froxlorlocal /etc/php/7.3/fpm/pool.d/h3.vagas.co.il.conf:user = froxlorlocal /etc/php/7.3/fpm/pool.d/h3.vagas.co.il.conf:group = froxlorlocal /etc/group-:froxlorlocal:x:9999:www-data /etc/subgid:froxlorlocal:100000:65536 /etc/gshadow:froxlorlocal:!::www-data /etc/shadow:froxlorlocal:*:17990:0:99999:7::: /etc/gshadow-:froxlorlocal:!::www-data /etc/subuid-:froxlorlocal:100000:65536 /etc/subgid-:froxlorlocal:100000:65536 /etc/passwd-:froxlorlocal:x:9999:9999:,,,:/home/froxlorlocal:/bin/false /etc/passwd:froxlorlocal:x:9999:9999:,,,:/home/froxlorlocal:/bin/false /etc/group:froxlorlocal:x:9999:www-data
  12. For one of my friend's company this _could_ be interesting, if you have proper backups / depending on how those are handled. This is the biggest thing that keeps us from moving to other solutions, currently we use duplicity to backup encrypted on some cloud service(s) and moving elsewhere would mean usually a lot of drawbacks on the backups / backup retention time etc. But just see it as note, maybe many other customers have other problems / priorities and this won't be one with them maybe. Anyways: Good luck and success with your new project!
  13. Thank you very much for your help. Yes they were in there. I think that will solve it! (Used --remove instead of --delete.) Thank you!
  14. Yes sorry, I meant 0.10.17-1 (current latest). [Tue 26 May 2020 12:07:10 AM CEST] 3155.co.il:Verify error:Invalid response from https://3155.co.il/.well-known/acme-challenge/iySt9DPeykV5--MPZDoEbhBcdRhvDERKKhybpcJk7oo [2606:4700:3036::681f:4e4a]: [Tue 26 May 2020 12:07:10 AM CEST] Please add '--debug' or '--log' to check more details. [Tue 26 May 2020 12:07:10 AM CEST] See: https://github.com/acmesh-official/acme.sh/wiki/How-to-debug-acme.sh [Tue 26 May 2020 12:07:11 AM CEST] Error renew 3155.co.il. [Tue 26 May 2020 12:07:20 AM CEST] hasade.vagas.co.il:Verify error:DNS problem: NXDOMAIN looking up A for hasade.vagas.co.il - check that a DNS record exists for this domain [Tue 26 May 2020 12:07:20 AM CEST] Please add '--debug' or '--log' to check more details. [Tue 26 May 2020 12:07:20 AM CEST] See: https://github.com/acmesh-official/acme.sh/wiki/How-to-debug-acme.sh [Tue 26 May 2020 12:07:21 AM CEST] Error renew hasade.vagas.co.il. [Tue 26 May 2020 12:07:29 AM CEST] hibur-ins.co.il:Verify error:Invalid response from http://hibur-ins.co.il/.well-known/acme-challenge/WWxo_yP7fATDcZu1kpf7ejm3YIoXhKieZupJ-uFrmuI [88.218.117.67]: [Tue 26 May 2020 12:07:29 AM CEST] Please add '--debug' or '--log' to check more details. [Tue 26 May 2020 12:07:29 AM CEST] See: https://github.com/acmesh-official/acme.sh/wiki/How-to-debug-acme.sh [Tue 26 May 2020 12:07:30 AM CEST] Error renew hibur-ins.co.il. [Tue 26 May 2020 12:07:45 AM CEST] lerougeparis.com:Verify error:DNS problem: NXDOMAIN looking up A for lerougeparis.com - check that a DNS record exists for this domain [Tue 26 May 2020 12:07:45 AM CEST] Please add '--debug' or '--log' to check more details. [Tue 26 May 2020 12:07:45 AM CEST] See: https://github.com/acmesh-official/acme.sh/wiki/How-to-debug-acme.sh [Tue 26 May 2020 12:07:50 AM CEST] Error renew lerougeparis.com. [Wed 27 May 2020 12:07:12 AM CEST] 3155.co.il:Verify error:Invalid response from https://3155.co.il/.well-known/acme-challenge/MCobMUL5wTPs-XCoir5oTSihu4ye3Guac5Kviz6FQ-c [2606:4700:3036::681f:4e4a]: [Wed 27 May 2020 12:07:12 AM CEST] Please add '--debug' or '--log' to check more details. [Wed 27 May 2020 12:07:12 AM CEST] See: https://github.com/acmesh-official/acme.sh/wiki/How-to-debug-acme.sh [Wed 27 May 2020 12:07:14 AM CEST] Error renew 3155.co.il. [Wed 27 May 2020 12:07:23 AM CEST] hasade.vagas.co.il:Verify error:DNS problem: NXDOMAIN looking up A for hasade.vagas.co.il - check that a DNS record exists for this domain [Wed 27 May 2020 12:07:23 AM CEST] Please add '--debug' or '--log' to check more details. [Wed 27 May 2020 12:07:23 AM CEST] See: https://github.com/acmesh-official/acme.sh/wiki/How-to-debug-acme.sh [Wed 27 May 2020 12:07:23 AM CEST] Error renew hasade.vagas.co.il. [Wed 27 May 2020 12:07:36 AM CEST] hibur-ins.co.il:Verify error:Invalid response from http://hibur-ins.co.il/.well-known/acme-challenge/J14Nx0fTR-91ZK4bR02twD1wk-KwyU0ptaeTVCCv_DQ [88.218.117.67]: [Wed 27 May 2020 12:07:36 AM CEST] Please add '--debug' or '--log' to check more details. [Wed 27 May 2020 12:07:36 AM CEST] See: https://github.com/acmesh-official/acme.sh/wiki/How-to-debug-acme.sh [Wed 27 May 2020 12:07:37 AM CEST] Error renew hibur-ins.co.il. [Wed 27 May 2020 12:07:49 AM CEST] lerougeparis.com:Verify error:DNS problem: NXDOMAIN looking up A for lerougeparis.com - check that a DNS record exists for this domain [Wed 27 May 2020 12:07:49 AM CEST] Please add '--debug' or '--log' to check more details. [Wed 27 May 2020 12:07:49 AM CEST] See: https://github.com/acmesh-official/acme.sh/wiki/How-to-debug-acme.sh [Wed 27 May 2020 12:07:52 AM CEST] Error renew lerougeparis.com. [Thu 28 May 2020 12:07:10 AM CEST] 3155.co.il:Verify error:Invalid response from https://3155.co.il/.well-known/acme-challenge/axNKAqQ64Giv_34HhADn71RDTXxqz0Wgu7HRyO8QlhY [2606:4700:3031::681f:4f4a]: [Thu 28 May 2020 12:07:10 AM CEST] Please add '--debug' or '--log' to check more details. [Thu 28 May 2020 12:07:10 AM CEST] See: https://github.com/acmesh-official/acme.sh/wiki/How-to-debug-acme.sh [Thu 28 May 2020 12:07:13 AM CEST] Error renew 3155.co.il. [Thu 28 May 2020 12:07:22 AM CEST] hasade.vagas.co.il:Verify error:DNS problem: NXDOMAIN looking up A for hasade.vagas.co.il - check that a DNS record exists for this domain [Thu 28 May 2020 12:07:22 AM CEST] Please add '--debug' or '--log' to check more details. [Thu 28 May 2020 12:07:22 AM CEST] See: https://github.com/acmesh-official/acme.sh/wiki/How-to-debug-acme.sh [Thu 28 May 2020 12:07:23 AM CEST] Error renew hasade.vagas.co.il. [Thu 28 May 2020 12:07:31 AM CEST] hibur-ins.co.il:Verify error:Invalid response from http://hibur-ins.co.il/.well-known/acme-challenge/uPHrDnThy_o4SkeAvV_Az1qVz-4k0vzNf_pgtVCXeK8 [88.218.117.67]: [Thu 28 May 2020 12:07:31 AM CEST] Please add '--debug' or '--log' to check more details. [Thu 28 May 2020 12:07:31 AM CEST] See: https://github.com/acmesh-official/acme.sh/wiki/How-to-debug-acme.sh [Thu 28 May 2020 12:07:33 AM CEST] Error renew hibur-ins.co.il. [Thu 28 May 2020 12:07:44 AM CEST] lerougeparis.com:Verify error:DNS problem: NXDOMAIN looking up A for lerougeparis.com - check that a DNS record exists for this domain [Thu 28 May 2020 12:07:44 AM CEST] Please add '--debug' or '--log' to check more details. [Thu 28 May 2020 12:07:44 AM CEST] See: https://github.com/acmesh-official/acme.sh/wiki/How-to-debug-acme.sh [Thu 28 May 2020 12:07:47 AM CEST] Error renew lerougeparis.com. 3155.co.il - We don't host ourselves since many months and removed it from the panel. hasade.vagas.co.il - was removed long time ago for now. hibur-ins.co.il - same as 3155.co.il. Lerougeparis.com - we removed this from SSL port (but maybe I also need to remove it from Let's Encrypt, so might be partially our fault for this one?).
×
×
  • Create New...