- main - earth.li

Combining log files
by Mark Rogers 26 Jan '18

26 Jan '18

I have many gigabytes of .gz compressed log files, generally in very small files. For example, one file only contains entries from 20180114-205608 to 20180114-205746 (about 90s), and is about 350k compressed. I want to extract these and combine them into one file per day*, compressed. Log file entries are in date/time order, and filenames are easily sorted into date/time order too, so I can easily generate a stream of log entries in date/time order from which to work. So I assume that what I need is something to pipe that to that will look at the date of each line, and if it's changed close any existing output file, open a new one (gzipped), and write to it until the date changes or EOF. I could write something like that in a scripting language (for my sins PHP would be easiest, Python I'm getting better at, bash could likely do it too). But given the volume of data are there any suggestions as to the "right" tool to use? Is this a job for awk or similar? As an aside: The files are all archived on my Linux box, but they're sourced from a Windows box, so a cross-platform solution would allow me to do it on the host; transferring lots of small files isn't as efficient as a few big files (athough I have archives going back years on my Linux box to work through first). * I say a file per day but ideally I could be flexible about the period - day is most likely and probably easiest though -- Mark Rogers // More Solutions Ltd (Peterborough Office) // 0844 251 1450 Registered in England (0456 0902) 21 Drakes Mews, Milton Keynes, MK8 0ER

3 9

Network monitoring scripts
by Mark Rogers 22 Jan '18

22 Jan '18

I have a Pi which is set up with a read-only filesystem, and as such packaged network monitoring solutions aren't happy. Neither wicd nor network-manager like this setup. I'm not a fan of either, to be honest - for a GUI based PC they have benefits but for a headless box something simpler will suffice. I have cobbled together a basic bash script that checks to see if it can ping the default gateway and restarts wifi otherwise, but its far from elegant. Has anyone done anything similar or found any similar scripts online that they use? Ideally, for example, it would be able to "manage" both eth0 and wlan0 (or even wlan1 - in the case of a Pi 3 with an external Wifi added in for better signal strength). (I'm worried about edge cases with my current script. I can either run in through cron, but that risks it thinking the network is offline just because it hasn't come up yet after a boot which might have bad side effects. I'm currently running it as a systemd service with e network dependency to avoid that, but I'm not sure how that'll work if the network fails to come up after a reboot. Then there's all the things I haven't thought of...) -- Mark Rogers // More Solutions Ltd (Peterborough Office) // 0844 251 1450 Registered in England (0456 0902) 21 Drakes Mews, Milton Keynes, MK8 0ER

3 12

Kontact crash
by Phil Thane 19 Jan '18

19 Jan '18

Happy New Year all, here's my first bug of the year. Using Kontact on Mint 18.3 (KDE) it's been fine for ages then yesterday, this: Kontact opens in Kmail which works fine. Choosing other modulkes from the sidebar I find Contacts (Kaddressbook) or Calendar (Korganizer) cause Kontact to crash. Other modules do not. Running from a terminal doesn't provide much info except an invalid socket warning. KCrash: crashing... crashRecursionCounter = 2 Following a crash the app has clearly not exited properly because socket errors keep on coming until I close the terminal. *phil@phil-desktop* *~ $* QSocketNotifier: Invalid socket 53 and type 'Read', disabling... Running Korganizer direct from a terminal is OK. Running Kaddressbook isn't. It opens for a fraction of a second, just long enough to see the window, then crashes. Similar error messages to the above. As I have little idea what a socket is, I'm stumped! The KDE reporting tool reports that the log isn't detailed enough to bother with and I can't find any useful advice online. Help?! -- Phil Thane www.pthane.co.uk phil(a)pthane.co.uk 01767 449759 07582 750607 Twitter @pthane

3 4

[ALUG Announce] ALUG Norwich Pub Meet Thursday 11th January
by Viperfang 09 Jan '18

09 Jan '18

ALUG Announce Please send announcements to Announce(a)lists.alug.org.uk Unsub, change settings via https://lists.alug.org.uk/mailman/listinfo/announce ----- Hello Norwich Aluggers, Our monthly ALUG Norwich social meeting will be held this Thursday, 11th January at The Coach and Horses (82 Thorpe Road, Norwich, NR1 1BA). The meeting officially starts at 8pm, although some people may arrive earlier. More information on those people can be found on the list and the IRC channel. If you are unsure if you will recognise us then make yourself and your intent to attend known by either posting on list or visiting us on IRC so we can look out for you rather than hiding in the corner. Optionally you could ask at the bar if they know where the geeky computer weirdos are and they'll point you in the right direction (seriously!). Another possibility is look for heaps of electronics on a table that may possibly look like movie props that would used for detonating explosives. Feel free to bring electronics/laptops/gadgets to the meet, you will by no means be alone. Ben Bewick aka Viperfang NB: This mail is automated, please refer to the usual sources for more information. ALUG Contact Details: Website : http://www.alug.org.uk/ IRC : #alug on irc.alug.org.uk List : http://lists.alug.org.uk/mailman/listinfo Twitter : http://twitter.com/anglianlug Identica: TBA Facebook: http://www.facebook.com/group.php?gid=2381613902 ----- Send discussion replies to main(a)lists.alug.org.uk (Reply-To set) Unsub, change settings via https://lists.alug.org.uk/mailman/listinfo/announce

1 0

2600 meeting at 18:00 on Friday the 5th January.
by Viperfang 04 Jan '18

04 Jan '18

Quick heads up about this months Norwich 2600 meeting, more info at http://www.norwich2600.co.uk

1 0

Scoring in the Gnome game "Five or More"??
by Ted Harding 26 Dec '17

26 Dec '17

Greetings All! And Happy Christmas and Happy New Year. I am trying to find out what formula is used to determione the scores in the Gnome game Five or More, in which you score BY "lining up" 5 or more counters of the same colour on a 9x9 board. In fact it's a bit more general than that, and any 2 or more intersecting lines, where with your latest move you have made each line contain 5 or more counters all of the same colour, then you get a score which depends on the total number of counters in these lines. Theae counters arre then erased and their cells become empty. For a single line (vertical or horizontal or diagonal) you can score with 5/6/7/8/9 counters. To score more than 9, you need at least three lines, which intersect at a single empty cell into which you then drop a counter of the same colour, combining 2 of the line into a line with 6/7/8/9 and with 4 more in the third ine. Then you score with 10/11/12/13 counters. And, if I've got it right, the biggest number of counters you can score with is when you have 8 lines, each with four counters, intersecting at the centre of the 9x9 square which is still an empty cell; and then you drop a counter into that square, and then you score with 33 counters. The "Help" page for gthe Gnome game says: Number of objects Score given 5 10 6 12 7 18 8 28 9 42 10 82 11 108 12 138 13 172 14 210 so it only goes up to 14 counters. However, as I describe above, one can go higher (up to "Number of objects" = 33. Trying to give this a go, I did succeed in achieving 17 (four diagonal lines with 4, plus 1 for the cell where they meet), and my score jumped from somewhere in the hundreds to 4106; so clearly one can score in the thousands with "Number of objects" = 17. But since I have seen no documentation which tells how many points you score for more than 14 counters, and have not seen any description which describes how the score is calculated from "Number of objects". Does anyone know, or can find out? with thanks, and best wishes to all, Ted.

2 2

New Server Recommendations
by steve-ALUG＠hst.me.uk 21 Dec '17

21 Dec '17

For many years I've been running a 2nd-hand "desktop" machine as a home server, which runs print, file & email services and a few others. It's an least 10 Y/O Pentium (5?) with 3GB RAM and is usually not taxed by these services. I have asked before, but I've never actually got round to doing anything about it, but I've got executive approval from the S/O BUT.... I'm in two minds. Do I go for A) a traditional box, plenty of room, RAIDed disk but comparatively high power consumption e.g. https://www.entroware.com/store/desktops/nyx or https://secure.zeta.systems/store/desktops/D540/ which seem to have PSUs rated about 650W or B) a small NUC style box, low power consumption thingy like https://www.entroware.com/store/desktops/aura or Something like the mini-itx jobbies available here https://www.logicsupply.com/uk-en/products/commercial-computers/mc500-serie… These seem to consume about 65W. I will be running some flavour of Ubuntu on it. I'd probably prefer it was 64Bit. I want it to be a "standard architecture" processor so that there will be a full-range of apps available to install from the ubuntu repositories. I would like to have a low-power-consumption as it's an always on device, and it doesn't seem to need much processing power. I'd also like to have raid (mirroring), but most low power-consumption machines don't seem to have space for raid. Does anyone have any comments or recommendations, especially of any companies they have dealt with, or products they have purchased that work well? Thanks in advance. Steve

8 31

Amber intends to combat encryption!
by Phil Thane 19 Dec '17

19 Dec '17

I've been having 'fun' corresponding with my MP (Burt, con) and our much-loved Home Secretary about her plans to ban encrypted messaging. The gist is here, with links: https://pthane.co.uk/blog/ Scroll back a bit for the first installment. Feel free to register and comment, I don't claim to be an expert, I could well be wrong, but it seems I know more that the Home Office. -- Phil Thane www.pthane.co.uk phil(a)pthane.co.uk 01767 449759 07582 750607 Twitter @pthane

4 4

Restarting wifi and network on a headless Pi
by Mark Rogers 14 Dec '17

14 Dec '17

I don't know if this is Pi specific, I assume it's just standard Debian. I'm using Raspbian Stretch. Suppose I have a working wireless connection. I can change wireless configuration in /etc/wpa_supplicant/wpa_supplicant.conf to remove the working details and then use "wpa_cli reconfigure" to take effect. Except that I remain connected to the wifi that I no longer have settings for, and cannot force it to disconnect. What is the correct way to force the change to have effect other than reboot? On a related note, how do I change the IP configuration for the cabled network and have that take effect? Making changes to /etc/dhcpcd.conf works after a reboot but I can't reliably make it work without rebooting. (Restarted dhcpcd will add a new IP address, but won't remove old ones and doesn't seem to let me revert to DHCP reliably either.) In both cases, making a connection seems easier than dropping one. Mark -- Mark Rogers // More Solutions Ltd (Peterborough Office) // 0844 251 1450 Registered in England (0456 0902) 21 Drakes Mews, Milton Keynes, MK8 0ER

2 5

Are there *any* decent web browsers out there now?!?!
by Chris Green 11 Dec '17

11 Dec '17

I'm finally getting a bit fed up with Firefox, for a couple of reasons:- It's seems incapable of working with eBay without going to 100% CPU and slowly grinding to a halt. The last few updates have made it *look* decidedly clunky. Arcane configuration parameters required to make it so it can open files on one's local file system. So, I've been looking at alternatives and there's not much that seems any better (they have different issues in the main). I've been trying chromium and it certainly seems faster than Firefox and doesn't seem to grind to a halt on eBay, but:- I want a separate search bar You can't change the keyboard shortcuts Is anything else any better? I've been wondering about Vivaldi, same underlying engine as Chromium but apparently much more configurable. Has anyone here tried it? I'm just a bit wary of going 'off piste' as it were (not in the Ubuntu repositories). -- Chris Green

7 14